Techniques for programming event-driven transactions in mobile applications

ABSTRACT

Techniques for interacting with a client process on a mobile device connected to a network over a wireless link include receiving, at a mobile interactions server, a first message from the client process. The first message indicates a first action by a user of the mobile device. The first action is related to a first graphical element displayed on the device for requesting a service from an application. Based on the first message, it is determined whether the action is associated with an event type of a plurality of predetermined event types. If it is determined the action is not associated with the event type, then, without invoking any method of the application, first data is generated. The first data describes any change in the first graphical element. The first data is sent to the client process for changing the display of the first graphical element.

CLAIM OF PRIORITY

This application claims priority to U.S. provisional application Ser. No. 60/222,817, filed Aug. 4, 2000 entitled “Techniques for Implementing Mobile and Industrial Database Applications” by Jyotirmoy Paul, Jeff Barton, Anit Chakraborty and Siva Dirisala, hereby incorporated by reference in its entirety. This application also claims priority to and is a Continuation-In Part of U.S. application Ser. No. 09/631,884, filed Aug. 4, 2000 entitled “Multi-Device Support for Mobile Applications Using XML” by Jyotirmoy Paul, Jeff Barton, Anit Chakraborty and Siva Dirisala, hereby incorporated by reference in its entirety.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is related to U.S. patent application Ser. No. 09/872,066, filed May 31, 2001 entitled “Maintaining State Information in Mobile Applications,” by Jyotirmoy Paul, Jeff Barton, Anit Chakraborty and Siva Dirisala.

This application is related to U.S. patent application Ser. No. 09/872,986, filed May 31, 2001 entitled “Techniques for Navigating in Mobile Applications,” by Jyotirmoy Paul, Jeff Barton, Anit Chakraborty and Siva Dirisala.

This application is related to U.S. patent application Ser. No. 09/872,566, filed May 31, 2001 entitled “Techniques for Supporting Multiple Devices in Mobile Applications,” by Jyotirmoy Paul, Jeff Barton, Anit Chakraborty and Siva Dirisala.

FIELD OF INVENTION

The present invention generally relates to network-based services for mobile, wireless devices. The invention relates more specifically to performing complex transactions for a network-based service using an event-driven interface.

BACKGROUND OF THE INVENTION

Society is becoming increasingly reliant on network-based services. Network-based services are any services provided to devices over a network. Common network-based services include, for example, services provided over the World Wide Web, database services, etc.

Services provided over the World Wide Web are typically presented in the form of one or more web pages. A web page is data expressed in a HyperText Markup Language (HTML) and transferred over a network using the hypertext transfer protocol (HTTP) of the Internet protocol (IP). The network can be a local network, a wide area network, or the Internet itself, a public network of computer networks.

Database services may be provided by a database application, which in turn may access a database through services provided by a database server. A database application is a software application that communicates with a database server process on the network to store data into and retrieve data from a database.

According to the Internet protocol (IP), a program on one device connected to the network interacts with another program located on another device with asynchronous stateless messages. The two programs run independently and interact only through these messages. The messages are asynchronous in that each can take an arbitrary amount of time to travel from source device to destination device. Consequently, two successive messages may arrive out of order. The messages are stateless in that each message is sent, transmitted and received independently, without inheriting or relying on characteristics from any previous messages sent.

The program that initiates the communication is a client process, and the program that waits for and responds to a request from the client process is the server process. The term “client” is often used to refer to either the client process, or the machine on which the client process runs, or both. The term “server” is similarly used to refer to either the server process, or the machine on which the server process is executing, or both.

A widely used client process supported by many servers on the Internet is a browser. A browser communicates with servers to retrieve and decode data expressed in HTML. HTML marks portions of the data with tags related to the manner in which the portions are to be displayed.

Adding programs, referred to as plug-ins, to a browser can extend a browser's functionality. A browser that has added functionality due to one or more plug-ins is referred to herein as an extended browser. Extended browsers may, for example, use input forms into which the user can enter data that is validated in some regard before being sent back to the server. Standard HTML does not provide for this client side validation process.

Portable devices capable of wireless communications are finding ever more uses and popularity. Some of these mobile devices are able to connect to a network. It is desirable to make network-based services available for access by such network capable mobile devices.

When making network-based services available for mobile devices, one cannot count on the ability to use software designed for a general-purpose computer. The smallest laptops are too cumbersome for some uses, such as for wireless telephony and for warehouse inventory control. Handheld devices used by agents of an enterprise in the field for these uses have limited hardware and software due to constraints imposed by limited size and low power availability.

For example, screen size, memory and plug-in functionality on the handheld device may be significantly less than what is available through a browser on a laptop, so that a Web page easily viewed on a low-end laptop is essentially unintelligible on the mobile device. A network-based service cannot rely on a particular mobile device having a screen of a needed size or having the power to execute a full browser or to accept plug-ins, such as those that allow the browser to use forms.

Some of these small footprint handheld devices may not run a World Wide Web browser at all. For example, mobile telephones use a wireless application protocol (WAP), which does not respond to the full set of HTML tags. These devices use data presented in a wireless markup language (WML), a specific implementation of the extensible markup language (XML) using a WML-specific document type definition (DTD). Other handheld devices used in industry, such as bar code readers, communicate with a network using a teletype protocol (Telnet), which accepts or sends one character at a time, with little or no display options such as font size, font type, italics, and color, and without the capability for displaying images.

Even the keys vary from one mobile device to another. Some devices may have a full keyboard like that on a PC, others may have just a few keys. For example, a mobile telephone typically has a twelve-key keypad and one or more function keys for performing certain functions such as answering the telephone or dialing a call. It is extremely burdensome for an application to monitor and respond to user actions involving each key of each keypad arrangement.

Complex interactions, such as those involving shopping online or employing an expert system to diagnose symptoms of a problem, require many messages to be sent back and forth between a client process and one or more server processes. In some cases, a first process must pass along “state information” with a first message to a second process, so that the second process will pass the state information back in a subsequent message to the first process. The state information received by the first process in the subsequent message lets the first process know that the subsequent message is related to the same transaction as the first message.

Because there is a wide variety of mobile devices, with a wide range of screen sizes, colors, memory sizes, page buffers, processor types and client protocols, among other properties, it is generally cost prohibitive to try to duplicate all the functionality of a network-based service for each possible mobile device.

Based on the foregoing, there is a clear need for techniques that allow network-based services to be made readily available to a wide range of mobile devices or to support complex transactions, or both, without having to explicitly program each network-based service to support all forms of mobile devices. There is also a need for a way to insulate an application providing the network service from the details of handling every keystroke by the user or a mobile device.

SUMMARY OF THE INVENTION

Techniques are provided for interacting with a client process on a mobile device connected to a network over a wireless link. According to one aspect of the invention, the techniques include receiving at a mobile interactions server a first message from the client process. The first message indicates a first action by a user of the mobile device. The first action is related to a first graphical element displayed on the device for requesting a service from an application. Based on the first message, it is determined whether the action is associated with an event type of a plurality of predetermined event types. If it is determined the action is not associated with the event type, then, without invoking any method of the application, first data is generated. The first data describes any change in the first graphical element. The first data is sent to the client process for changing the display of the first graphical element.

According to one embodiment of this aspect, if it is determined that the action is associated with the event type, then second data is generated. The second data describes a particular event of the event type. A particular event handling method of the application is invoked to provide the service. The particular event handling method is associated with the event type. The second data is passed to the event handling method.

According to another embodiment, the plurality of predetermined events types does not include an event type associated with the user of the mobile device pressing a character key.

According to another aspect of the invention, the techniques include sending from an application to a mobile interactions server first data. The first data describes a first graphical element for display on the mobile device. The first data also describes one or more event handling methods of the application associated with the first graphical element. Second data is received at a particular event handling method of the plurality of event handling methods. The second data describes an event having a particular event type of a plurality of predetermined event types. The second data is received in response to an action by a user of the mobile device. A service is provided for the client process in response to receiving the second data. The particular event handling method is associated with the particular event type. The mobile interactions server determines whether the action is associated with the particular event type.

An advantage of these event handling techniques is that the application developer can employ the observer-observable paradigm for software development. In the observer-observable paradigm a program element deals only with observable objects and ignores other objects. The observer registers the objects that are to be observable and the system notifies the observer when an observable object is generated, changes, or terminates. As applied to mobile applications developers, the mobile application is built to observe events of certain predefined event types. Other events, such as those associated with the user pressing each character key while entering data into a text field, or the user moving a cursor up and down on a list, are not registered observables for the application; and the developer does not develop instructions to handle events associated with those actions. As implemented in several embodiments, the built-in methods of the mobile interactions server handle the intra-field actions, and most of the intra-page actions, by the user.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:

FIG. 1A is a block diagram that illustrates one embodiment of a mobile applications server connected to a network with which a mobile device communicates over a wireless link.

FIG. 1B is a block diagram that illustrates a graphical object used by an embodiment of the mobile applications server 110 to interact with a mobile device.

FIG. 1C is a block diagram that illustrates an embodiment of an application comprised of a hierarchy of graphical objects and methods.

FIG. 1D is a block diagram that illustrates one embodiment of a mobile interactions server used in the mobile applications server of FIG. 1A.

FIG. 2A is a flowchart that illustrates one embodiment of a method for a mobile interactions server to respond to a client making an initial request for services.

FIG. 2B is a block diagram of a main menu on a screen of a mobile device produced in response to requesting applications from a mobile applications server.

FIG. 2C is a flowchart that illustrates one embodiment of a method for a mobile interactions server to respond to a subsequent action by a user of the client process.

FIG. 2D is a block diagram of an event object used by the mobile interactions server.

FIG. 3 is a block diagram that illustrates an embodiment of a data structure for storing session state information by the mobile applications server 110.

FIG. 4A is a flowchart that illustrates a method for handling a special key event.

FIG. 4B is a flow chart that illustrates exception handling methods of the mobile interactions server.

FIG. 5A is a diagram that illustrates an embodiment of a page on a display of a mobile device.

FIG. 5B is a diagram that illustrates an embodiment of a next page on a display of a mobile device.

FIG. 6A is a flowchart that illustrates one embodiment of a method for a device-sensitive presentation manager to prepare page output for a particular mobile device.

FIG. 6B is a flowchart that illustrates one embodiment of a method for an XML to protocol converter to manage page output for a particular mobile device.

FIG. 7 is a flowchart that illustrates one embodiment of a method for an application developer to utilize a mobile interactions server.

FIG. 8 is a block diagram that illustrates a computer system upon which an embodiment may be implemented.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.

Operational Context

To illustrate network applications interacting with mobile devices employing a wireless link, consider FIG. 1A. FIG. 1A is a block diagram that illustrates one embodiment of a mobile applications server 110 connected to a network 108 with which a mobile device 101 communicates over a wireless link 106.

The mobile device 101 includes a screen display 102, one or more keys 104 and a client process 103 running on a microprocessor (not shown) in the mobile device 101. Some mobile devices may include a sensor 105, such as a microphone or barcode reader. The mobile device 101 communicates with a base station 107 using a wireless link 106 that may be proprietary. Examples of wireless links include a local radio frequency link such as IEEE 802.11, a wide area radio frequency link, a satellite link, and a personal communication services (PCS) data link through a WAP Gateway.

The base station 107 is connected to the network 108. The base station 107 passes network message traffic between the client 103 and the servers on the network 108. The network 108 may be any network using an asynchronous stateless protocol like TCP/IP, including a local network, a private wide area network, or the Internet.

The mobile applications server 110 includes one or more processes executing on a machine connected to the network 108. According to one embodiment, the mobile applications server 110 provides functionality for the mobile device 101 beyond the functionality built into the processor and client 103 on board the mobile device itself.

In one embodiment, the mobile applications server 110 provides one or more applications 116 that may be used by a mobile device over the network 108. For example, assume that mobile device 101 is a device having a barcode reader as the sensor 105. Such a device may be used in conjunction with an inventory application to update an inventory database. The update may be performed by scanning the barcode on an item and pressing a key to indicate whether the item is being added to the inventory, or is being removed from the inventory due to damage, due to sale, or due to transport to another warehouse.

For another example, a database application for mobile device 101 having a microphone, such as a mobile phone, could identify the user of the mobile device based on a comparison of the user's voice with a voice print for the user. The voice print may be maintained in a database by a database server on the same platform as the mobile applications server 110 or some other server platform on the network 108.

The mobile applications server 110 may also provide non-database applications. For example, if the sensor 105 is a global positioning system (GPS), then the mobile application could compute the area walked off by a user carrying the mobile device 101 based on positions output from the sensor 105 and transmitted to the mobile applications server 110.

According to several embodiments, applications 116 on mobile applications server 110 interact with mobile device 101 through a mobile interactions server 150 in the applications layer. The network device on which mobile applications server 110 executes also includes processes that execute in a network layer, a transport layer, and a security layer that are not significantly modified by the invention and are not described further.

Overview of Functional Components

Referring to FIG. 1A, mobile applications server 110 is one or more processes executing on a computing device connected to the network 108 that provides services for a mobile device 101 in response to one or more requests for services from the client process 103 executing on the mobile device 101.

Mobile applications server 110 includes one or more applications 116. In general, an application is a set of instructions that can be called to cause one or more processors to perform a series of related tasks for providing a requested service. An application often requires input data and produces output data. An application often comprises one or more methods that can be invoked separately each with their own input and output.

Many ways of producing applications are known in the art. For example, in one embodiment, the application is a package of JAVA classes containing public methods that can be invoked separately by the name of the method and the name of the class. Input for each public method is provided as one or more data structures called parameters and output is provided as a returned data structure. The names of the public methods, and the names and definitions of the input and returned data structures are published as an application programming interface (API). In another embodiment, the application is a library of methods created in another language that also has a published API. In still other embodiments, the application is a compiled program executed by a command line in the operating system language for the platform on which the applications reside. The compiled program operates on input in data files or on an input stream and produces output in data files or on an output stream, all defined in the operating system language. In yet other embodiments, the application is a script in the operating system language that executes several compiled programs in sequence.

Each application of the mobile applications 116 on the mobile applications server 110 provides functionality for mobile devices. As described in the background section, different mobile devices may have different characteristics. For example, different devices may communicate on the network through their base stations with different protocols (e.g., WAP, HTTP, Telnet), may have different keys and sensors, and may have different screen sizes, different memory capacities and different processing power. Such differences in characteristics complicate obtaining input for the application and presenting output from the application. These applications 116 are special in that they communicate with the mobile device 101 through a mobile interactions server 150, described next, in a manner that does not require developers of the application 116 to address specific characteristics of the individual mobile device 101.

The mobile applications server 110 includes the mobile interactions server 150 that provides data or methods or both for obtaining input data from the mobile device, for presenting output data at the mobile device, and for managing the data communicated with the mobile device. The mobile interactions server 150 receives requests from the client process 103 through the mobile device base station 107 and returns responses to the client process 103 through the base station 107. The mobile interactions server also passes data to the applications 116 involved, causes methods of the applications 116 involved to be executed, and receives any output from the applications 116 for the mobile device 101. The mobile interactions server thus operates to intercede between the application 116 and the mobile device 101 to insulate the application 116 from dealing with specific characteristics of individual mobile devices.

In the embodiment of FIG. 1A, the mobile interactions server 150 generates additional components at runtime in response to an initial request from the client process 103. These additional components include a listener 152, a state machine 154 and a state information database 155. The listener 152 is a process launched by the mobile interactions server 150. The listener monitors a port associated with input having a particular protocol (e.g., HTTP, WAP, or Telnet) on the mobile applications server. The listener acts in response to requests received from a client process on the port and causes data to be sent back to the client process over the network.

In the embodiment depicted, the listener produces descriptions in the extensible Markup Language (XML) of graphical elements for display on the screen 102 of mobile device 101 which are sent to a conventional XML converter 112 described below. When monitoring some ports, however, the listener 152 does not send an XML document. Instead, the listener 152 produces a response for the mobile device in the protocol used by the base station 107. For example, when listening on a Telnet port, the listener produces a response using the Telnet protocol. In this case, the response is sent to the base station via the network 108 and bypasses the conventional XML converter 112. If the response produced by the listener 152 for the client process uses the methods of an application 116 or information from previous requests and responses, then the listener causes a method of a state machine 154 to be executed and the listener bases the response for the client process on the data returned from the state machine 154.

The state machined 154 is a process that is launched by the listener. In some embodiments, the state machine 154 is a library of methods invoked as controlled by the listener 152. In other embodiments, the state machine 154 is a background process that executes in parallel waiting for a particular message upon which to act. The state machine 154 receives data from the listener 152 based on requests from the client process and returns responses to the listener 152 for the client process. The state machine 154 also determines which methods of which applications 116 are involved and causes the involved methods to be executed.

The state machine 154 also manages information about multiple requests and responses involving the client process for each client process communicating over the port. The state information database 155 is persistent storage for the information managed by the methods of the state machine 154 for the client process during the client communication session with the mobile interactions server. Thus, the state machine 154 and state information database 155 enable applications to perform complex transactions in which a response passed to the client in response to a request contains or depends on information carried in a previous request or response. In some embodiments the state information database survives for a limited time after communication with the client terminates—in case the break in communications is an unintentional interruption. If the client reestablishes communication within the limited time, then the state machine method invoked by the listener to commence a session with the client identifies the existing state information database for the client and employs the existing database instead of creating a new one.

The mobile applications server also includes a conventional XML converter process 112, which translates descriptions in the eXtensible Markup Language (XML) of graphical elements for display on the screen 102 of mobile device 101 to descriptions used by the base station 107 for several protocols. Conventional XML converters use an eXtensible Stylesheet Language (XSL) to translate from XML to any of several markup languages used by a variety of base stations. However, there is not a standard markup language for Telnet devices, and conventional XML converters do not translate XML descriptions into a markup language for Telnet. In an alternative embodiment, shown in FIG. 1D, the listener 152 produces Telnet protocol responses that are sent to the network 108, bypassing the conventional XML converter 112.

FIG. 1D is a block diagram showing an embodiment 150 b of mobile interactions server 150. This embodiment includes an embodiment 152 b of listener 152 in which the listener 152 includes a device-sensitive presentation manager 140 and an XML to protocol converter 114. The device-sensitive presentation manager is a process that modifies the format of data received from the state machine for display on the screen 102 of the mobile device 101 based on information particular to the mobile device before sending the information to the client process.

For example, the data from the state machine indicates a menu of 10 items, but the screen 102 of the particular mobile device 101 has only five lines. The device-sensitive presentation manager 140 receives data indicating the menu with the ten items, determines that the mobile device has a display screen that only shows five lines, and reformats the data to send one of three subsets of the data, each subset indicating five lines of graphical display or less. For example, the first subset of data indicates four menu items for the first four lines and a button labeled “next items” for the fifth line. The second subset of data indicates three menu items for the middle three lines, a button labeled “prev items” for the first line and a button labeled “next items” for the fifth line. The third subset of data indicates a button labeled “prev items” on the first line followed by the last three menu items on the next three lines.

In the illustrated embodiment, the information particular to a mobile device comes from a device profile database 145 holding information about the characteristics of mobile devices. In other embodiments, the information comes from prompting the mobile device for its characteristics and obtaining an answer in a process called negotiating. In some embodiments the process is performed by invoking a method in a library of methods, in another embodiment the process executes in the background waiting for input from the listener.

In the illustrated embodiment, the output from the device sensitive presentation manager 140 is in XML, which is used as a common markup language relatively easily converted to device-specific protocols. In another embodiment, a different markup language is used as the common markup language.

Listener 152 b also includes an internal XML to protocol converter 114. The internal converter 114 is a process that receives data in XML and converts it to a protocol used by the base station 107 of the mobile device 101. Some protocols use data in mark up languages produced by an external conventional XML converter 112. For these protocols, the internal XML to protocol converter 114 sends the XML data to the external conventional XML converter 112 with little or no change, as shown in FIG. 1A by arrow 113 a. The external XML converter 112 uses XSL to produce different markup languages tailored to types of mobile device and sends data in these markup languages over the network as shown in FIG. 1A by arrow 113 b. The external XML converter 112 produces various versions of HTML for HTTP clients like web browsers, a Handheld Device Markup Language (HDML) for some devices, a markup language for voice capable gateways (VoxML), and various versions of WML, such as for ERICSSON™ and NOKIA™ 7110 devices. An Example of a conventional XML converter suitable for the external converter 112 is PORTAL-TO-GO™ of the ORACLE™ Corporation.

For other protocols for which there is not a standard markup language, the internal XML to protocol converter 114 performs parsing of the XML data and converts the data to messages that follow the protocol. For example, for the Telnet protocol, the internal XML to protocol converter 114 determines which XML elements are displayed on the next line and sends the contents of those elements, character by character, to the base station 107, as dictated by the Telnet protocol. These Telnet responses are not sent to the external conventional XML converter 112 but are sent directly to the network as indicated by arrow 113 c in FIG. 1D for the base station, bypassing the external conventional XML converter 112. This internal XML to protocol converter 114 is especially useful with industrial devices, for example, with industrial bar code readers used on the floor of a warehouse or factory, which communicate with an inventory database application over a local area network using the Telnet protocol.

Graphical Elements

According to the present invention, the applications 116 communicate indirectly with the mobile devices through the mobile interactions server 150 using data that describes one or more graphical elements that may be displayed on the screens of the mobile devices and may be associated with actions by a user of the mobile device, such as moving a cursor and pressing a key. Several types of known graphical elements are associated with known actions by a user who manipulates a cursor on the screen of the mobile device and coordinates the use of one or more keys on the mobile device. Among the known graphical elements are a text field, a button, a check list, a set of radio buttons, and a pull down menu (also called a popup menu). According to the disclosed techniques, the application employs these graphical elements and others to prompt for and obtain a series of inputs from a user of the mobile device in order to conduct a complex transaction. The techniques allow an application designer to include graphical elements without the application designer providing the details of how the graphical elements are communicated to the mobile device or how much information is stored on the mobile device.

For example, an application can be built to allow a mobile telephone user to search for a name in a telephone directory maintained in a telephone directory database by a third party and to download the name and number to the mobile telephone's speed dial list maintained in persistent memory on the mobile telephone. The application constructs a first set of graphical elements for the mobile telephone to prompt the user of the telephone to input each character of the name being searched for. This set of graphical elements used together is called a page. The application uses the name input by the user to construct a query to send to the third party database to obtain a list of names and numbers that match the name being searched for. The application then constructs another page of one or more graphical elements to present the one or more resulting names and prompt for the user to select one or more. In response to further user action, the application then constructs another page of graphical elements to prompt the user to indicate whether the selected names should be added to the speed dial directory or dialed or ignored. Based on the response the application issues a command that causes the telephone to add the numbers to the telephone's speed dial directory or to dial a selected one number or to simply end the application. According to the techniques described below, this application can employ all the graphical elements needed without dealing with the details of the protocol to communicate with the device, or how the graphical element is rendered on the screen of the mobile device, or maintaining all the user inputs in persistent storage.

The Structures for Graphical Elements

The fundamental building block for a graphical user interface for interacting with a user of the mobile device is the graphical element. A page is constructed of one or more graphical elements that are intended to be used together by a user of the mobile device. An application is built of one or more pages. When a user first requests services from the mobile applications server, the user is presented with a main menu including a menu item for each selectable application on the mobile applications server. When the user selects one of the menu items, the user is presented with the first page of the corresponding application.

The graphical element and the page and the menu item are implemented as objects in an object-oriented language like JAVA™. In object-oriented implementations, an object is a data structure that is a particular instance of a data structure type defined in a class. The objects are said to be instantiated from the class. The class defines the attributes and methods for all the objects in the class. While all objects instantiated from the same class have the same attributes, the values that those objects store for those attributes may vary from object to object. Furthermore, an attribute may be defined to refer to an object of a second class, so that the value this attribute takes is an object of the second class. Classes can inherit some or all of their attributes and methods from other classes which themselves may inherit attributes and methods from other classes. In JAVA, the classes form a hierarchy and a class can only inherit from classes above them in the hierarchy to avoid cyclic inheritance. In JAVA several classes are stored together in a package. Each class in the package has a unique name and the names together constitute a namespace.

According to the object oriented implementation, a menu item object corresponding to the application includes one or more page objects as attribute values, and each page object includes one or more field objects as attribute values. A field object corresponds to a graphical element.

Mobile Applications Bean Objects

A bean is a class of objects with at least a minimum set of attributes and methods, including a bean name and a method for listing the attributes (i.e., properties) and attribute values of each object. This method gives the bean class the behavior of introspection. In one embodiment the bean class methods includes a method for setting a value for an attribute of the object, and a method for getting the value of the attribute. These methods give the bean class the behavior of persistence, and, by providing a standard format for storing and retrieving information, give the bean class the behavior of serialization. In this embodiment, the methods provide the functionality to store and retrieve the attributes and attribute values of instances of the bean class or of instances of classes that inherit from the bean class.

In another embodiment, the bean class includes a vector of event handling methods. An event is an object generated by a listener in response to a message from a client process. Different listeners produce different event types. The event received from the listener is the input parameter for the event handler corresponding to the event type. The vector of event handlers in the bean class handle events in response to a user of the mobile device activating a control of the mobile device 101, such as by pressing a key 104 of the mobile device, using a pointing device on the mobile device, or turning on the sensor 105. In some embodiments, event handling methods are implementations of interfaces for handling event objects. An interface is data that defines the name for a method and the names of the parameters used as input to the method, and the class of the objects used as values for the parameters, and the class of the object returned, if any. The class is often identified by the name of the class; the name of the class of which an object is an instance is also called the type of the object. An implementation of an interface provides the instructions to use the parameters to produce the returned value.

A JavaBeans class is a commercially available, published bean class including methods for providing introspection, persistence and event handling.

According to the present disclosed techniques, mobile applications beans are provided to an application developer and used in the application. A mobile applications bean is a class that inherits the attributes, attribute values and methods of a bean class and extends them for describing a graphical element, a page or an application menu item. The mobile applications bean extends the bean class by providing an additional one or more attributes or by replacing one or more methods or by adding one or more methods or interfaces, or by some combination of these changes. A menu item bean is a mobile applications bean extended to provide the attributes and methods used when an application is invoked or launched and when the application terminates. A page bean is a mobile applications bean extended to provide the attributes and methods used when a page is entered and exited. A field type bean class is a mobile applications bean class extended for each graphical element. A different field type bean class is defined for each of the known graphical elements used to interact with a user of a mobile device. For example, a field type bean class is defined for a text field, a button, a radio button, a checklist, a list, and a list of selectable values, as described in more detail below.

FIG. 1B shows some of the main attributes and methods included in a mobile applications bean 180. A mobile applications bean 180 includes a bean name 181 and a bean value 182 as required by all beans. The mobile applications bean also includes zero or more attributes and attribute values 184 particular to the type of mobile applications bean. In this context the type of a mobile applications bean is used to indicate one of the menu item bean, the page bean, and the field type beans, such as the text bean, the button bean and other beans mentioned above or described in more detail below.

The mobile applications bean 180 includes a method 187 for generating an XML document that describes the graphical element to be displayed on a screen of the mobile device to represent an object of the mobile applications bean. An XML document that describes a graphical element for display on a variety of mobile devices is described in more detail in the related application incorporated by reference in its entirety above.

The mobile applications bean 180 includes a method 188 for handling an event generated by a listener when a graphical element corresponding to the bean is involved in an action by the user of the mobile device. For some mobile applications beans this method 188 is just an abstract method naming the method and the parameters and the parameter types and including a return statement to end the method, but not performing any significant functions. The event handling method is to be written by the application programmer when the application is built in order to have the event handling method perform the desired tasks of the application as described with an example below. The mobile applications beans include default event handlers for all events generated by the mobile interactions server. In addition, a set of event handlers, corresponding to a limited set of predefined events, is defined in a mobile applications interface so that the application developer can provide the instructions to execute upon occurrence of one of the predefined events. The predefined events are high-level, generic events that insulate the application from the device-specific details of user actions on the mobile device, such as keys stroked and pointing device characteristics manipulated.

For example, a predefined field-entered event is generated when a cursor on the screen 102 of the mobile device 101 enters a graphical element associated with a field type bean. A pre-defined special-key-pressed event is generated when a special key of the keys 104 is pressed to move to a different page without completing and submitting the current page. A pre-defined page-exited event is generated when a user indicates the user is finished with the page, such as when an enter key is pressed with the cursor placed on a button labeled “submit.” If the application does not include instructions for the event handling methods for these events, the mobile interactions server employs one of the built-in event handlers for these events. More details on the event handling methods and interfaces are described in a later section.

The Field Bean

The field beans describe the attributes and behavior of the graphical elements displayed on the screen 102 of the mobile device 101 and used to display information to the user or collect data from the user or both.

According to one embodiment, a set of nine field types are defined by corresponding field type bean subclasses of a field bean subclass of the mobile applications bean. The set of nine field bean types are provided to the application developer to instantiate and add event handlers to provide the behavior for the application being developed. The nine field type beans include a text field bean, a list of values (LOV) field bean, a list field bean, a multi-list field bean, a checkbox field bean, a radio field bean, a button field bean, a heading field bean, and a separator field bean. The values assigned to properties of the field beans are used to customize the instantiated field type for particular applications. For example, the “hidden” property of a text bean may be set to “true” to suppress display of the value. Similarly, the “editable” property of a text bean may be set to “true” to allow the user to type characters that replace the characters currently in the value of the bean. Default values provided for some attributes are assigned if the application does not explicitly assign other values. In the preferred embodiment, a method 187 for generating an XML document for each field type bean is built-in and need not be written or replaced by the application developer.

FIG. 5A shows how text field beans are rendered on a Telnet device having a fourteen line display. This display is based on the XML document produced by method 187 for this subclass and subsequently processed by the XML to protocol converter 114. A device using the Telnet protocol adds one character at a time to the current line of a display device, except that a special “line-feed” character displays a new line with no characters. Some Telnet devices display only the current line, others display several lines. On Telnet display 501, text field bean 514 is displayed as a string of characters including a text field prompt 515 and a text field value 516. A prompt is an attribute (i.e., property) of this text field subclass, which has a value of “ACCT” for the object displayed. The “ACCT” prompt value indicates the text field 514 contains a value for an account number.

The editable attribute of this text field element is indicated by the XML document produced by method 187 for this bean. The editable field is rendered as a reversed background highlight 517 according to the XML to protocol converter 114 based on information in the device profile database 145 about the display used by this device. For example, it is determined from the device profile database that the display on the particular mobile device in which the client process is executing supports reverse background text. Then the editable text is highlighted on this Telnet display by reversing black and white for the characters and background. The user of the mobile device may replace the characters in the value of this field bean with other characters indicating a different account number. As the user strokes each character key, the built-in event handling method 188 for the text field bean automatically uses the XML generating method 187 to produce an XML document that describes the new character in the field and the cursor moved to the next position. The application developer does not have to replace either method 187 or 188 and therefore does not need to know the details of communicating with the mobile device.

Sample attributes of the nine field bean classes are provided in Tables 1 through 9. Values are assigned to these attributes by the application to specify the layout of the graphical elements with which a user of the mobile device receives and enters data. The information in each of the following tables is also used in the method 187 to generate XML documents for the objects instantiated from the bean. The method 187 to generate XML uses an XML document type definition (DTD) for the bean. The DTD defines XML element tags that correspond to the field bean types and attributes that correspond to the entries in the “Attribute” column. The DTD also specifies data types for the attributes that correspond to the entries in the “Allowed Values” column and default values that correspond to the entries in the “Default Value” column in the Tables 1 through 9. A corresponding style sheet is used by the XML converters 112 and 114 to translate the XML document into other markup languages or protocols.

If an attribute is inherited from the field bean of the mobile applications bean, a “yes” appears in the “Inherited” column in Tables 1 through 9. A short description of the graphical effect of the attribute on a corresponding graphical element ultimately produced on the screen of a mobile device is included in the column titled “Graphical Effect.” The “get”, “set” and “is” columns refers to the bean class methods used to access the attribute; the “is” method is used to get an attribute value that holds a logical value “true” or “false”.

A text field bean object is used to display text or receive text input from a user. Constraints on user input, if any, are described by some of the attributes for this bean. Table 1 shows attributes of the text field bean.

TABLE 1 Text field bean attributes Allowed Default Attribute Inherited Graphical Effect Values Value get set is Name yes none any string NULL X X Prompt yes displayed text to any string NULL X X prompt user input 9 characters in length or less Hidden yes do not display the “true” “false” “false” X X field Required no field cannot be “true” “false” “false” X X exited until a character is input AlterCase no forces the input “U” for upper “N” X X characters to “L” for lower appear in upper or “N” for no lower case forcing Value no displayed text in consistent with NULL X X input area ValueType attribute ValueType no refuses input of the “S” for string “S” X X wrong type “N” for number “D” for date “R” for range NextPageName no controls navigation string for NULL X X upon exiting field unique name of next page Editable yes Value attribute “true” “false” “true” X X changed by user input indicated by highlighting Password no do not display “true” “false” “false” X X Value attribute Length no maximum number any number “10” X X of characters allowed on input

A list of values (LOV) field bean object is used to present the user with a pop-up list of selectable items and obtain user input signifying one of the selectable items, such as in a pop-up (or pull down) menu. The bean for these objects allows the list of selectable items to be determined dynamically at runtime by providing an attribute to store a command that launches a procedure to generate the list. The command is a structured query language (SQL) statement or a call to a packaged procedure in JAVA or PL/SQL, a proprietary extension of SQL supported by the ORACLE™ Corp. A result set produced in response to executing the procedure may include more than one subfield for each listed item, so the bean provides attributes to describe the subfields and their display. An example of how a LOV bean object is displayed on a Telnet device is provided later. Table 2 shows attributes of the LOV bean.

TABLE 2 List of values (LOV) field bean attributes Allowed Default Attribute Inherited Graphical Effect Values Value get set is Name yes none any string NULL X X Prompt yes displayed text to any string NULL X X prompt user input 9 characters in length or less Hidden yes do not display the “true” “false” “false” X X LOV field Required no field cannot be “true” “false” “false” X X exited until a choice is input AlterCase no forces the input “U” for upper “N” X X characters to “L” for lower appear in upper or “N” for no lower case forcing Value no displayed text in consistent with NULL X X input area ValueType attribute ValueType no refuses input of the “S” for string “S” X X wrong type “N” for number “D” for date “R” for range NextPageName no controls navigation string for NULL X X upon exiting field unique name of next page Editable yes Value attribute “true” “false” “true” X X changed by user input indicated by highlighting Length no maximum number any number “10” X X of characters allowed on input LOVstatement no command that SQL query, or NULL X X causes a processor packaged to generate list of procedure with values from which one results set user will select output Input no none array of strings NULL X X Parameters with input parameters for procedure in LOVstatement InputParameter no none array of strings NULL X X Types with input parameter types “S” string in session memory “N” number in session memory “D” date in session memory “T” time in session memory “AS” string “AN” number “AD” date “AT” time SubfieldNames no none array of strings NULL X X with names of subfields on each listed item in results set Subfield no text displayed array of strings NULL X X Prompts proximate to each for each subfield displayed subfield Subfield no display subfield array of “true” NULL X X Displays “false” values SelectedValues no none array of strings NULL X X for all subfields in selected list item The input for the procedure in the LOV statement attribute may be provided directly when the object is instantiated from the LOV bean. The LOV bean also allows the parameters input to the procedures to be obtained from the information managed by the state machine for the session, as indicated in Table 2 by the expression “session memory.” In the illustrated embodiment session memory is the state information database 155. If the input parameter comes from session memory, the input parameter is provided not by a value but instead by the reference to the information in the session memory. In some embodiments the reference is a unique name for the information as described in more detail later. The InputParameterTypes attribute holds strings that indicate whether each input parameter is an actual string (AS), number (AN), date (AD) or time (AT), in which case the type begins with the letter “A”, or whether each input parameter is a reference to a string (S), number (N), date (D) or time (T), in the session memory, in which case there is no “A” prefix.

A list field bean object is used to display lists of related items or receive text input from a user for some or all of the listed items or both. Constraints on user input, if any, are described by some of the attributes for this bean. Table 3 shows attributes of this field bean.

TABLE 3 List field bean attributes Allowed Default Attribute Inherited Graphical Effect Values Value get set is Name yes none any string NULL X X Value yes number of items in any number NULL X X list if all displayed Prompt yes displayed text to string of 9 NULL X X prompt user input characters in length or less Hidden yes do not display the “true” “false” “false” X X field Values no displayed text in array of values NULL X X input area consistent with ValueType attribute ValuesTypes no refuses input of the array of types NULL X X wrong type “S” for string “N” for number “D” for date “R” for range ValuesLabels no text displayed array of strings NULL X X adjacent to listed of 9 characters item or less NextPageName no controls navigation string for NULL X X upon exiting field unique name of next page Editable yes One item on list “true” “false” “true” X X selected by user input indicated by highlighting SelectedItem no determines which number ≦ NULL X X item is highlighted Value

A multi-list field bean object is used to display multiple lists of related items or receive text input from a user for some or all of the listed items or both. Constraints on user input, if any, are described by some of the attributes for this bean. A multi-list bean is useful for receiving input into a table of rows and columns. Table 4 shows attributes of this field bean.

TABLE 4 Multi-list field bean attributes Allowed Default Attribute Inherited Graphical Effect Values Value get set is Name yes none any string NULL X X Value yes number of lists in any number NULL X X object if all displayed Prompt yes displayed text to string of 9 NULL X X prompt user input characters in length or less Hidden yes do not display the “true” “false” “false” X X field Numbers no number of items in array of NULL X X each list numbers Values no displayed text in array of values NULL X X input area of all consistent with items in all lists ValueType attribute ValueType no refuses input of the array of types NULL X X wrong type “S” for string “N” for number “D” for date “R” for range ValuesLabels no text displayed array of strings NULL X X adjacent to listed of 9 characters item or less NextPageName no controls navigation string for NULL X X upon exiting field unique name of next page Editable no Values attribute array of “true” “true” X X changed by user “false” values input indicated by highlighting Length no maximum number array of NULL X X of characters numbers allowed on input for each list

A checkbox field bean object is used to allow a user to select none, one, some or all of one or more options. The checkbox is especially useful when the options require many characters to specify. Table 5 shows attributes of the checkbox field bean.

TABLE 5 Checkbox field bean attributes Allowed Default Attribute Inherited Graphical Effect Values Value get set is Name yes none any string NULL X X Prompt yes displayed text to any string NULL X X prompt user input Hidden yes do not display the “true” “false” “false” X X field Required no field cannot be “true” “false” “false” X X exited until a choice is input Checked no check mark “true” “false” “false” X X appears in box or equivalent NextPageName no controls navigation string for NULL X X upon exiting field unique name of next page Editable yes Checked attribute “true” “false” “true” X X changed by user input

A radio button field bean object is used allow a user to select one or more of several related options. The radio button is especially useful when the options are mutually exclusive. Table 6 shows attributes of the radio button field bean.

TABLE 6 Radio button field bean attributes Allowed Default Attribute Inherited Graphical Effect Values Value get set is Name yes none any string NULL X X Prompt yes displayed text to any string NULL X X prompt user input Hidden yes do not display the “true” “false” “false” X X field GroupName no relates several any string NULL X X radio buttons with same GroupName GroupLabel no displays text any string NULL X X proximate to several radio buttons Required no field cannot be “true” “false” “false” X X exited until a choice is input Checked no solid dot appears “true” “false” “false” X X in circle or equivalent Exclusive no only one radio “true” “false” “true” X X button in group may be checked NextPageName no controls navigation string for NULL X X upon exiting field unique name of next page Editable yes Checked attribute “true” “false” “true” X X changed by user input

A button field bean object is used to present a button to a user of a mobile device and receive input indicating completion of input for the current page. For example, a “SUBMIT” or “DONE” or “OK” button is instantiated from the button field bean. Typically a task is performed by the application and then a new page is displayed to the user. Table 7 shows attributes of the button field bean.

TABLE 7 Button field bean attributes Allowed Default Attribute Inherited Graphical Effect Values Value get set is Name yes none any string NULL X X Prompt yes displayed text to any string NULL X X prompt user input 9 characters in length or less Hidden yes do not display the “true” “false” “false” X X field NextPageName no controls navigation string for NULL X X upon exiting field unique name of next page

The header field bean is used to insert text into the header or title area of a screen on a mobile device. Attributes of a header field bean are shown in Table 8.

TABLE 8 Attributes of a header text bean In- Graphical Allowed Default Attribute herited Effect Values Value get set is Name yes none any string NULL X X Value yes displayed text any string NULL X X

The separator bean is used by some of the other beans to provide a consistent use of characters that signal to a user of the mobile device the type of input expected after a prompt. For example, in one embodiment a colon (:) is used as a separator between a prompt and a text value in a text field bean and a greater-than sign (>) is used as a separator between a prompt and a value selected from a list of values in a list of values bean. Attributes of a separator bean are shown in Table 9.

TABLE 9 Attributes of a separator bean In- Graphical Allowed Default Attribute herited Effect Values Value get set is Name yes none any string NULL X X Value yes displayed single NULL X X separator character character Type no type of field “text” NULL X X bean in which “LOV” separator is “list” used “multilist” “check- box” “radio” “button” “heading”

The Page Bean

A page object is intended to represent a group of graphical elements that are used together. A page object includes instances of one or more field beans listed in the page bean's attribute named field beans vector. The page bean extends the bean class to include a constructor method that instantiates the page and a method to add field beans to the field beans vector attribute. The page bean also extends the bean class to include page event handling methods. Logic can be included in the page bean's event handling methods to add field beans at runtime so that the pages can respond dynamically, for example in response to the information managed by the state machine.

The page bean class also includes a multiple-instance attribute, which determines whether a user can navigate to a particular page object more than once. For example, the user may press a “submit” button that returns the user to a page named “Shopping Cart”. This can either be treated as a return to a Shopping Cart page with values for the attributes as they were when the page was left, e.g., with one or more items in the cart, or treated as a new instance of the page with newly generated attributes, e.g. a second shopping cart that is empty. The multiple instance attribute allows the second instance of the shopping cart page in the example. The mobile interactions server 150 allows for multiple instances of a page bean if this attribute has a value of “true.” The two pages with the same name are distinguished by an instance number. For example, the mobile applications server allows a Shopping Cart 1 page and a Shopping Cart 2 page.

The Menu Item Bean

A menu item bean extends the mobile applications bean with methods that should be executed when an application is first started, or when the application is exited. An applications developer extends the menu item bean for a particular application by providing event handlers. One of the event handlers includes a reference to the first page bean of the application. Any application-specific start up and exit procedures are provided as event handling methods.

The file and name of the menu item bean for a particular application are registered with the mobile interactions server by the applications developer when the application is ready for offering to users of mobile devices. At the time of registration, the applications developer also provides the mobile applications server with a label to be presented to a user when the user first starts a communication session with the mobile applications server. The label becomes one item in a menu presented to the user as a first response after the user logs in with the mobile applications server 110.

Furthermore, in one embodiment, the value of the menu item bean name attribute is used with the values of the page name and field name to uniquely identify every graphical element in the application. This property is very useful for maintaining state information as it is described in more detail in a later section.

Structure of an Application

FIG. 1C is a block diagram that illustrates how, according to one embodiment, an application may be implemented using a hierarchy of application specific mobile applications beans. At the top of the hierarchy is an application specific menu item bean 170. In this embodiment the application specific menu item bean extends the menu bean described above by including a method 171 to be executed when the application is exited. The application specific menu bean also includes a reference 179 a to the first application specific page bean. In some embodiments the reference is a file name where the application specific first page bean is stored. In some embodiments the page reference is in an event handling method for the application entered event.

The first page bean 172 a includes a method 175 a to construct the page object and a vector 174 a listing one or more application specific event handling methods 174 a associated with the page. The methods may be included in the file with the page or may be in any class file associated with the application. In the illustrated embodiment, the first page constructor 175 a creates instances of several field beans including field bean objects 173 a and 173 b. The first page constructor also lists an application specific event handling method associated with field bean 173 b. The event handling methods for the page listed in vector 174 are for generic events, described in more detail below, which insulate the application from details of the mobile device 103.

With this structure the page can generate instances of field beans that depend on conditions at the time the page is generated. That is, the page-entered method of the page event handlers listed in vector 174 a may include instructions that determine what additional field beans to instantiate and the values of field bean attributes based on the date or time, the identity of the user, or any information managed by the state machine about the current session with the client at the time the page is generated. For example, if the user had indicated on a previous page that the telephone numbers of two people with the name John Smith are desired, the current page can obtain that information from the state information database and add two instances of text field beans to the page built by the constructor, and use the two new text fields to display the phone numbers of the two John Smiths.

The first page bean also includes a reference 179 b to a subsequent page, e.g. the next page. In the embodiment shown, the reference 179 b to the next page is an attribute external to page event handling methods listed in vector 174 a. In another embodiment the exit page event handling method of the listed page event handlers in vector 174 a makes the reference to the next page. In still another embodiment, a field bean 173 includes the reference to the next page. In one embodiment, the application specific value of the “Next Page” attribute in a field bean object indicates the reference to the next page. An application specific page bean may include different references to different pages in the “Next Page” attributes of several different field bean objects; in this case, the next page generated by the application depends upon the field object a user of the mobile device is acting on. In some embodiments the reference is a file name where the next application specific page bean is stored.

The page beans continue for as many pages as necessary to provide the desired functionality for the application. When the last page is exited, the page event handler method of the last page issues a message indicating that no more pages follow. In this embodiment, an exit application event occurs, and the exit application event handler method 171, if any, in the menu item bean is executed. In one embodiment, to deal with any circumstance that results in no new page being generated, the application specific methods generate an exception that is a message to the mobile interactions server. Such circumstances include exiting the application, redirecting control to another network-based service, or encountering an error while executing the logic of the event handler method.

An advantage of this arrangement is that the overall application is broken up into a series of pages that each approximately correspond to the amount of information that a user of the mobile device should consider at one time. The pages are constructed and operated independently and in series so that only one occupies the processor at any one time for one session. As a result, the number of program instructions that must occupy the memory of the processor at any one time is a small subset of the overall instructions needed to provide all the functionality of the application. What information needs to be shared between one page and another is stored in the session state information maintained by the state machine of the mobile interactions server.

Another advantage of this arrangement is that each page of the application may be extended without regard to the detailed properties of individual mobile devices. Those details are handled by the methods and attributes inherited from the mobile applications beans provided to the application developer.

Mobile Interactions Server Processes

The operation of the mobile interactions server shall now be described with reference to the structures of the embodiment illustrated in FIGS. 1A, 1B, 1C and 1D. The steps followed when a client process first contacts the mobile interactions server are described in the following section on client log-in. The steps followed by the mobile interactions server 150 after receiving a subsequent request message from the client indicating actions by the user are described in the next sections. The state information maintained by the mobile interactions server to facilitate interaction during the entire course of a session between the client and the mobile applications server 110 is described in the section on session state maintenance. Separate sections below are directed to describing in more detail navigation between pages, the event-driven interface, the presentation manager, and application development. A hardware overview section is also provided.

Client Log-in

FIG. 2A is a flowchart that illustrates one embodiment 210 of a method for a mobile interactions server 150 to respond to a request from a client on a mobile device for services from the mobile applications server 110. For example, a user employs the mobile device to log on to the mobile applications server 110. This initial request can also be made without the log-in procedure, if the security policy does not require log-in.

In step 201, the mobile interactions server waits for a request from the client to start a session. In step 202, the mobile interactions server determines whether a request was received from the client to start a session. In other embodiments, steps 201 and 202, are replaced by different steps. For example, steps 201 and 202 are replaced by steps of an event trigger mechanism that passes control to the following steps when a request is received, without intermediate checking. Alternatively, steps 201 and 202 are replaced by a step that calls routines that implement the following steps on a predetermined schedule.

If a login is required, then control is transferred to a log-in process (not shown) and returned to step 204, if successful.

When control passes to step 204, the mobile interactions server launches listeners to respond to further requests from the client process. The client process is identified by the network address of the mobile device and the port through which the messages are arriving at the platform on which the mobile interactions server 150 is executing. A different port is assigned by the operating system of the mobile applications server for each communication protocol and the port is passed to the mobile interactions server. For example, messages using HTTP are typically assigned port 80 and Telnet messages are typically assigned to a port with a different port number. One listener responds to the initial request. A second listener responds when the request message from the client indicates the user has pressed a key. The request includes data indicating the value of the key pressed and the name of the graphical element where the cursor was located when the key was pressed. A third listener responds to a logoff request. In other embodiments the first, second and third listeners are combined. The steps in FIG. 2A performed by a listener are performed by the listener that responds to the initial request.

In step 206, information about the mobile device on which the client is executing is obtained and stored in the device profile for the session by the listener. In some mobile devices, some of this information is obtained by negotiating directly with the client process on the mobile device. During negotiations one or more messages are sent to the mobile device from the mobile applications server, and the responses are used to construct the mobile device profile or determine the device type. For example, negotiations are used in some embodiments with industrial devices such as bar code readers that communicate via the Telnet protocol. For mobile devices that do not negotiate, such as devices using the WAP protocol, information pertinent to the devices and available from the manufacturer or published sources are maintained by the mobile interactions server in a database of device properties. Based on the request from the mobile device, which includes some identifying information, such as a manufacturer name and model name and date, a device type for the mobile device is determined. The listener, or, in some embodiments, the separate presentation manager, of the mobile interactions server then retrieves device profile information from the database based on the device type.

In step 208, the listener checks a list of registered menu items, corresponding to available applications, and determines which menu items should be made available to the client requesting the session, based on the device profile. If a log-in procedure has been required, then the security policy also determines which clients have access to which applications.

In step 210, the listener invokes a new session method of a state machine library of methods to initiate management of session state information generated during the session with the client. Included in the session state information passed to the state machine method from the listener for management is information describing the connection used to route packets to the client, such as the IP address of the base station, the port number at the base station used for the wireless connection, the port number of the platform on which the mobile interactions server 150 is executing, and the menu items available to the client. The state machine generates a session object to store this state information and places the passed information into the session object. The structure of the session object is described in more detail below. In the illustrated embodiment, the state machine stores the session object in a session state database. In other embodiments, the session object is stored in other manners, such as in main memory within a special memory buffer called session memory.

In step 212, the state machine method generates a page for the mobile device. In the illustrated embodiment, the page is represented as an XML document listing the menu items to be displayed on the mobile device. The state machine method returns the XML document to the listener 152. The listener 152 b employs the presentation manager 140, which reformats the page for the particular mobile device based on the device profile database 145. The presentation manager is described with more detail in a later section.

FIG. 2B shows a sample menu presented to a user on the screen of a mobile device in response to the client process request for applications from the mobile applications server 110. This screen includes a title text field 272 and three lines of selectable applications each represented by a line number in a text field 276 and a label for the application in a text field 274. A fourth option, to exit from the server, is represented by a line number in a text field 276 d and a text field 277 displaying the text “exit server.” An editable text input field 278 is represented by a prompt text field 278 a and an input text field 278 b. A user selects an option by typing a line number into text field input area 278 b. The graphical elements of this screen are sent to the mobile device by the listener based on the XML document received from the state machine in step 212. The listener maintains a mapping between graphical elements, as referenced by the mobile device, and the field bean names on the current page. For example, the listener maps the graphical element reference for the text field 278 to the name of its corresponding field bean, say “Selected Menu Item” included in the XML document.

All the steps described in FIG. 2A occur outside the application specific menu item bean, page beans, and field beans. The only involvement of the application developer for these steps to occur is that the developer register the application with the mobile interactions server as described in more detail below so that the application appears as one of the options on the main menu presented to the user. In the illustrated embodiment, the state machine and the listeners handle subsequent interactions between the application and the client.

In the illustrated embodiment, control then passes back to step 201, to wait for another client to request a session.

Processing User Actions as Events

FIG. 2C is a flowchart that illustrates one embodiment of a method for a mobile interactions server to respond to a subsequent action by a user of the client process. In this embodiment, all these actions cause events to be generated that are passed as input parameters to event handler methods. Most events are handled by the event handling methods inherited from the bean superclass, the mobile applications bean, and the nine field type beans. The application developer generates application-specific event handling methods for a set of predefined generic events. In the following the term “handler” is used as a short form for the expression “event handling method.”

In the depicted embodiment the client process 103 communicates with the mobile applications server 110 using the Telnet protocol in which each key pressed is communicated to the server as a request message. In this case the listener detects when a request message arrives on the Telnet port from the client process indicating a user has pressed a key. In other embodiments, the client may communicate with another protocol, such as HTTP extended with forms, in which the request message may indicate a higher level action, such as indicating that the user has submitted a completed form without intervening messages indicating each character typed by the user. Using HTTP, the listener detects when a request message arrives on port 80 with a string of characters indicating some of the attributes and values of the completed form.

In step 221 a Telnet listener, launched by the mobile interactions server 150 during step 204, waits for a request message from the client process indicating a user of the mobile device has pressed a key. Step 222 represents a branch point based on receiving the request message indicating a user action. If a request message indicating a user action is not received, the listener continues to wait as represented by the arrow returning control to step 221. If a request message indicating a user action is detected, control passes to step 223. For example, if a message indicates the user has pressed a numeric key while the cursor is located in the text input field 278 b, then the user action is “key pressed.” As another example, on the screen of FIG. 5A, the cursor may be on text field graphical element 514 placed after the character “4” when the user presses the “enter” key of the keys 104 on the mobile device.

In step 223, the listener generates an event object and invokes a handler of the state machine with the event object as an input parameter. The event object has an attribute for the key pressed and an attribute naming the field in which the cursor was located when the key was pressed. In this embodiment, an event object is an extension of a JAVA event object class. One embodiment of an event object 280 is depicted in FIG. 2D. The event object 280 includes several attributes and corresponding values 288 that hold the name of the field bean associated with the graphical element in which the cursor was located at the start of the user action and the name of the key that was pressed. For example, the attribute Name may have the value “Selected Menu Item” and the key pressed attribute may have value “3”. The event object is formed to pass information about the user action to the handlers implemented in the mobile applications beans.

The event object 280 includes several methods for retrieving information from the state information managed by the state machine methods. The event object inherits a “get source” method 282 from the JAVA event object class. The get source method returns a field bean object based on the stored state information for the field bean associated with the graphical element where the cursor was located. For example, the get source method returns the text field bean object named “Selected Menu Item” associated with the text field graphical element 278 displayed on the screen of the mobile device.

The “get session” method of the event object 280 returns the session object in which information about all the field beans sent to the client and all attributes modified by a user of the mobile device. In one embodiment, a reference to the session object that can be employed to access the information in the session object is returned rather than the session object itself. An embodiment of the session object is described in more detail later.

The “get action” method of the event object returns the user action in the source field. For example, the get action method returns the string “key 3 pressed” or the string “enter key pressed.”

The state machine has a handler for the example “key 3 pressed” event and generates other more generic events with more generic actions for the generic event handlers of the application, as described below. The generic events produced by the state machine include “field entered,” “field exited,” “page entered,” “page exited,” “special page key pressed,” “application entered,” and “application exited.” Six generic actions are associated with events passed to handlers of an application. The six generic actions are “next field,” “previous field,” “submit page,” “back page,” “forward page,” and “menu page.” The generic events and actions insulate the application from details of determining which keys are on which mobile devices and how cursors are used in each device to move from field to field on a page.

In step 224 the state machine method determines whether the key pressed action corresponds to one of the generic events, an exit field event. For example, a field is exited when an enter key is pressed or a pointing device is clicked on a button field, or if the field does not involve a list and either a cursor up key is pressed or a cursor down key is pressed. If the key pressed indicates a field is being exited, then the state machine handler sets the action in the event object to “previous field” if the exit is indicated by a cursor up key, and “next field” if the exit is indicated otherwise. If the action does not correspond to exiting a field, then control passes to step 226. The “key 3 pressed” does not correspond to a generic event, such as field exited; thus, in this example control passes to step 226.

In step 226 a field handler of the state machine specific to the field bean type is invoked with the event object as the input parameter to deal with the pressed key. A different handler is available for each type of field bean. Handlers for the nine field type beans are built-in for the state machine and are not produced by the application developer, and are not considered application handlers. In step 228, the state machine field handler revises the field based on the key pressed, updates the state information stored about the field in the session object and generates an XML document to return to the listener for sending on to the client process on the mobile device. After step 228, control then passes to step 221 to wait for further user action.

For example, the built-in text field handler for the “key 3 pressed” event revises the Value attribute of the “Selected Menu Item” to “3” and stores this Value in the Session object and generates an XML document with the new value. In one embodiment, the XML document includes descriptions of the entire page, recovered from the session object. In another embodiment, the XML document includes just the description of the revised field object. The XML document is returned to the listener that causes the new value to be rendered on the mobile device and the cursor to be moved to the position after the “3,” as is described in more detail below. For an example list field element, as depicted in FIG. 5B, a list field handler responds to a cursor down key being pressed by revising the field to show a different list item highlighted, updating the state information to indicate the highlighted item, and generating an XML document with the next item of the list highlighted and the former item, if any, changed from highlighted to not highlighted.

Processing Generic Events

If the action is associated with the generic event “field exited” in step 224, then control passes to step 230 to invoke a state machine exit field handler with the event object as the input parameter. For example if the action is associated with a generic “next field” action or a generic “previous field” action, then the action is associated with the generic “field exited” event type. A different exit field handler is invoked for each field type. The state machine includes exit field handlers and enter field handlers for the nine field types. The application can include its own application-specific handlers for the event types, when a page object is constructed. Note that the Main Menu Screen depicted in FIG. 2A is not constructed by the application but is automatically provided by the state machine and listener of the mobile interactions server. Thus no exit field handlers or enter field handlers for the field objects corresponding to the graphical elements on that page are provided by the application. On the other hand, if the field being exited was generated on a page provided by the application, then the field object information stored in the session object obtained with the event object identifies any application specific exit field handler. The state machine exit field handler determines whether the field object includes an application specific exit field handler; and, if so invokes the application specific exit field handler.

In step 233 the exit field handler determines whether a Next Page attribute contains a reference to page object of the application, or whether the exit field is the option input field of the main menu screen, or whether there is no remaining field on the page. If any of these conditions is true, control passes to step 240 described later. Otherwise, another field on the same page is being entered.

If the step 233 determines that another field on the same page is being entered, control passes to step 234 in which the state machine exit field handler invokes the state machine change field handler to leave a field without generating a new page object. In step 236 the state machine change field handler updates information in the session object about the field object being exited and determines which field object, if any, is being entered, based on the action included in the event object. For example, if the page is as depicted in FIG. 5A, and the field being exited is the text field element 514 with the prompt “ACCT” and the action is “next field” then the field being entered is the next one on the page in order, which is the text field element with the prompt “ITEM.” If, instead, the action were “previous field” then the field being entered would be the LOV field element 520 with the prompt “TXN TYPE.” The change field handler then adds a field entered event to the event object and a name of the field that will be entered. The source of this event does not change, it is still the field that is exited, but another field object is added to the event naming the field entered.

In step 238, the state machine invokes the state machine enter field handler for the field type of the field being entered. The state machine enter field handler determines whether the field object includes an application specific enter field handler; and, if so, invokes the application specific enter field handler. Control then passes to step 248.

In step 248 the state machine generates an XML document describing the page object, indicating which field element is the current field element and indicating the position of the cursor. In some embodiments only the changed field objects and cursor position are included in the XML document. In other embodiments the entire page object is described in the XML document. The XML document is then returned to the listener for preparing to present to the client process for display to the user of the mobile device. Control passes to step 221 to wait for another request message indicating user action at the mobile device.

If, in step 233, the exit field handler determines that a new page must be generated, it adds the “page entered” event to the event object, and control passes to step 240. In step 240, the state machine invokes an exit page handler for the current page, passing the event object as the input parameter. The state machine exit page handler determines whether the current page object includes an application specific exit page handler; and, if so invokes the application specific exit page handler, passing the event object as the input parameter. Control then passes to step 242.

In one embodiment, if the current page is the main menu page, then the state machine exit page handler uses the information in the session object to map the value of the option selected by the mobile device user on the main menu screen to a file where the application specific menu item bean and page beans are stored. The exit page handler then adds an “application entered” event to the event object and invokes the “enter application” handler of the menu item bean, passing the event object as the input parameter. The enter application handler returns a menu item object with a reference to the first page of the application. A menu item object is added to the session object in session memory.

If there is not another field on the page and the Next Page reference is empty, then the end of the application has been reached. The state machine exit page handler then adds a “application exited” event to the event object and invokes the “exit application” handler of the menu item bean. The exit application handler performs any application specific end of application functions and returns. The next page is the main menu screen and the state machine exit page handler invokes the main menu method, passing control to step 210 of FIG. 2A.

In step 242, the state machine invokes the instantiate page handler, passing the event object. This handler uses the reference in the Next Page attribute or the reference to the first page obtained through the event object to determine whether the page already exists in the session object and, if so, whether it supports multiple instances. If the page is not already in the session object, or if the page supports multiple instances, the handler invokes the constructor method for the page bean to instantiate the page. The page bean is identified in the Next Page attribute of the exited field or in the reference to the first page. The constructor method does not accept the event object as an input. The constructor method instantiates the page object and the field objects contained in the page object. The constructed page object includes a vector indicating any enter handlers and exit handlers for the page object and field objects on the page. Control then passes to step 244.

In step 244, the state machine invokes the state machine enter page handler with the event object as the input parameter. The state machine enter page handler makes the first field the current field and adds a “field entered” event to the event object. The state machine enter page handler determines whether the current page object includes an application specific enter page handler; and, if so invokes the application specific enter page handler, passing the event object as the input parameter. The enter and exit handlers included in the vector accept event objects as parameters. Therefore any field objects included on the page based on state information are instantiated by the application specific enter page handler. Similarly, any attributes that depend on the state information are assigned values in the application specific enter page handler. Control then passes to step 236 to update and store the session object, to step 238 to invoke the enter field handler for the current field on the new page, and step 248 to generate and return the XML document.

An advantage of these event handling techniques in the described embodiment is that the application developer can employ the observer-observable paradigm for software development. In the observer-observable paradigm, a program element deals only with observable objects and ignores other objects. The observer registers the objects that are to be observable and the system notifies the observer when an observable object is generated, changes, or terminates. As applied to mobile applications developers, the mobile application is built to observe certain events, e.g., the generic events. Other events, such as the user pressing each key while entering data into a text field, or the user moving a cursor up and down on a list field are not registered observables; and so the developer does not develop instructions to handle events associated with those actions. As implemented in the embodiment described, the built-in methods of the mobile interactions beans, such as the nine field type beans, handle the intra-field actions, and most of the intra-page actions, by the user.

The Built-in LOV Field Event Handling Methods

The state machine enter field handlers include built-in procedures to provide the behavior expected of the field types. For some field types the built-in behavior is complex. For example, when a LOV field is entered, such as the LOV field element 520 in FIG. 5A, the LOV-field-entered handler retrieves the contents of the LOV statement attribute provided by the application, which is a stored procedure or an SQL statement as described above. The handler causes the statement to be executed with the parameters provided by the application and included in the InputParameters attribute. If indicated by the InputParameterTypes attribute, one or more of the InputParameters may be retrieved from the session memory, e.g., the session object. The result set produced in response to executing the LOV statement is stored by the built-in handler, the result set is referenced by the LOV field name, for example in the session object. The result set is made up of records each of one or more subfields.

If the results set is empty after execution of the LOV statement the text value remains unchanged, an error message such as “Invalid Value” or “No Values Found” is generated and stored, referenced to the LOV field name, such as in the session object, and data is generated indicating the cursor position remains in the field. The error message and cursor data are included in the XML document produced in step 248. If the results set contains only one record, then the one record is placed into the SelectedValues attribute of the LOV field, the Value attribute is set to a subfield of the record that has a type that matches the type in the ValueType attribute, the event object is modified to add a “next field” action, and control passes to step 230 where the built-in exit LOV field handler is invoked with the modified event object. The built-in exit LOV field handler generates data indicating the cursor is positioned at the next field.

If the results set contains several records, then the displayed subfields of the records, as indicated by the SubfieldDisplays attribute, are placed into a list by the enter LOV field handler, the event type is modified to include the special action “generate LOV page,” and control passes to step 242 and following steps. In step 242 a built-in handler is invoked to instantiate the LOV page using the list. FIG. 5B is an example LOV page listing the transaction types (TXN TYPE) from which the value presented in LOV field 520 can be selected. In one embodiment, as shown in FIG. 5B, this handler includes a “select” button field. The “select” button has a NextPage attribute set to a reference to the previous page (the previous instance of the page, not a new instance of the previous page). In an embodiment in which the page is implemented as a single list field, the reference to the previous page is assigned to the NextPage attribute of the list field. In step 244 a built-in enter LOV page handler is invoked to set the selected item of the list to one of the list items, e.g., field 527. In an embodiment in which the page is implemented with a single list field, the enter LOV page handler sets the single list field as the current field. Control then passes to step 236 to update the session object to include the page object with the list corresponding to the page 510. In step 238 a LOV enter field handler is invoked with the event object. In one embodiment this handler selects one of the items of the list field as the selected item and locates the cursor on that item, e.g. field 527. In step 248 the state machine generates an XML document with the list and returns the XML document to the listener for display to the user.

In one embodiment, the user employs the up and down arrow keys without leaving the list field, through steps 226 to 228, as described above. When the user presses the enter key the state machine determines that a “next field” condition is satisfied and generates an event object with the next field and passes control to step 230. In an alternative embodiment, each cursor move is interpreted as an exit field event not associated with submitting a page, and is processed through steps 234 to 248 as described above. When in a field, pressing an enter key selects the corresponding list item, replacing any prior selections. When the user presses enter in the “select” button, then the page is submitted. In either case, a “page exited” event is added to the event object and the event is processed through steps 233 and 240 through 244.

In step 233 the reference to the previous page as the next page is detected, the state machine adds a “page exited” event to the event object and control passes to steps 240 to invoke the built-in exit LOV page handler with the event object. The built-in exit LOV page handler generates data indicating the cursor is positioned on the next field of the previous page (e.g., field 516) and the Value attribute is set to the appropriate subfield of the SelectedValues attribute. In step 242 the previous page is returned with the new selection occupying the Value attribute. In step 244 the state machine enter page handler for the previous page selects the field object corresponding to the cursor as the field being entered and invokes any application-specific enter page handler. In step 236 the session object is updated and in step 238 the state machine enter field handler is invoked for the field where the cursor is located, which itself invokes any application specific handlers. In step 248, the XML document for the current page is generated and returned to the listener.

An advantage to the application developer is that the complex behavior of the LOV field may be obtained simply by instantiating the LOV bean. The application developer does not have to generate handlers for any of the LOV field events.

Session State Maintenance

FIG. 3 is a block diagram that illustrates session state information stored by the state machine in the mobile applications server 110 according to an embodiment of the invention. In this embodiment, the session state information is maintained as a session object comprising attributes and methods. The attributes include connection information 342. The methods include a method 332 for getting connection information, method 334 to get the previous page, method 336 to store an arbitrary object in the session object, and method 338 to retrieve that arbitrary object. The arbitrary objects explicitly stored in the session object are represented by block 344.

Session object 310 includes a hierarchy of state information objects corresponding to the menu item objects, the page objects and the field objects in the applications in the order they were instantiated during the session. For example, an application state information object 350 a includes information from the first instance of the application, such as a unique name 359 a among the names of the applications available on the mobile applications server. The unique name is generated by the state machine based on the file name of the application and instance number. As each page is generated during interactions with the client process, a page state information object 351 is added to the application state information object.

For example, first page state information object 351 a is added when the first page is generated and returned to the state machine. This object includes a property 352 a for a unique name for the page. Object 351 a includes state information objects 353 for each field object on the page object. A field state information object 353 includes at least a unique name for the field, an identification of the type of field, and values for at least some of the attributes of the objects belonging to that type. Ellipses 312 indicate additional field state information objects to be included in the page state information object 351 a. Ellipses 313 indicate additional page state information objects may be included in the application state information object 350 a. Ellipses 314 indicate additional application state information objects may be included in the session object 310.

If multiple instance pages are allowed, several instances of the same page can be maintained in the session object 310. However, if multiple instance pages are not allowed, then as a user of the mobile device steps back to a previous page, the current pages are deleted and forgotten. On the second visit to a page, the attributes values may change. For example, the value of the “TXN TYPE” LOV field in field 514 of FIG. 5A may change from “RECEIPT” to “SHIP” after obtaining user input. In this case, no record would be kept of the former values for the attributes of the items on the page. For example, a page state information object would not exist in which the “TXN TYPE” was “RECEIPT”—memory of that state of the page would be lost. Only the most recent visit to the page would be stored in the session object 310.

A unique namespace for every object generated during the session is maintained. In one embodiment, a unique name is generated for the session, a unique name is generated for an application within the session, a unique name is generated for each page within an application, and a unique name is generated for each field object within a page. Then, even though the same page name may be used in different applications or the same field name in different pages of the same application, a unique name is generated for each object by appending its name, separated by a period, after the name of its parent and continuing on to the session name. For multiple instances of the same application, page or field, an instance number can also be appended.

For example, a unique session name is generated based on the client network address appended to a port number. For example, if the IP address of the mobile device is 002.002.002.002 and the port is 19, then a unique name for the session can be constructed by appending the latter to the former (omitting periods) to yield 00200200200219. A unique name for an application executed by this client is generated from the main menu item corresponding to the application and an instance number for the application. For example, if the main menu item for the application is option “3” with a label “Inventory Database Input” associated with a JAVA file “inv.java” in directory “Mobile/Database/Inventory” of the platform of the mobile applications server 110, then a unique name for the application can be one of: “3”; “InventoryDatabaseInput”; and “Mobile/Database/Inventory/invjava.” Assuming that “InventoryDatabaseInput” is used for balancing brevity with descriptiveness, and that the application is invoked for the first time of possibly multiple invocations, the unique name for the application is “00200200200219.1InventoryDatabaseInput.” A unique name for a second instance of a page bean named “Location” would then be “00200200200219.1InventoryDatabaseInput.2Location.” A unique name for the first field object named “Address” on the page would then be “00200200200219.1InventoryDatabaseInput.2Location.1Address.”

The unique name of an object in the namespace combined with the storage in a session memory of state information for all objects in association with their unique names allows the name to serve as a reference for all the information about that object.

The unique namespace also facilitates storage and retrieval in some embodiments. For example a database index is generated based on the unique name in one embodiment. The index maps the unique name of each object to a location in the database where the object or information about the object is stored. Then a particular object can be retrieved quickly from the database based on the unique name for the object.

In the preferred embodiment, the session object 310 is an instance of a bean class that includes as attributes the instances of the menu item beans, page beans and field beans generated during the session. For example, an instance of each page bean, including its instances of field beans, with all their attributes and attribute values is added to the session object as the page object is returned to the state machine methods. In this embodiment, the bean methods for storing and retrieving attributes and attribute values of instances of the beans are used to store and retrieve the session object, and thereby, every object included in the session object. Thus, the session object provides persistence and serialization for the state information managed by the state machine.

Using these techniques, the state machine is able to manage the state information for the session on behalf of one or more applications during a communication session with a particular client. The state machine adds state information at each branch point of a hierarchy as a page is constructed for the client. The state machine thus develops a complete tree representing the navigational path followed by the user.

At the same time, the state machine builds a namespace that uniquely identifies each field object. The unique identifier provides access for retrieving state information from the session object. Furthermore, the state machine has sufficient information at its disposal to handle up and down movements of a cursor on a page displayed at the mobile device, so that the applications would not have to provide methods to respond to such user actions.

As described above, the page object can include field objects that depend on information in the session object, because the event object passed to the page entered handler includes a method to get a reference to the session object. For example, if the user had indicated on a previous page that the telephone numbers of two people with the name John Smith are desired, the current page entered handler can obtain that information from the session object. Then, for example, the page entered handler can add two instances of text field beans to the page object to display the phone numbers of the two John Smiths.

These techniques free the developers of applications from the responsibility for managing their session state information. This greatly simplifies and accelerates the development of applications.

Client Navigation of Application Page

To illustrate how a user navigates through pages presented by an application, consider FIG. 5A. FIG. 5A is a diagram that illustrates an embodiment of a page 510 on a display 501 of a mobile device. On this page, each graphical element appears on a different line of the display. Depending on the display device, either the entire page is displayed to the user of the mobile device, or only one or a few lines of the page are displayed to the user of the mobile device. In either case, one or more keys on the mobile device allow the user to position a cursor on one of these lines. The position of the cursor may be indicated by a movable symbol or simply by highlighting the area of the graphical element, such as by outlining, or reversing color. The user may then perform some further action on the graphical element by pressing one or more keys on the mobile device. As used herein, selecting a graphical element includes placing the cursor on the graphical element and pressing a key on the mobile device when the cursor is positioned on the graphical element.

The manner in which the graphical element is rendered may provide cues to the user about what user actions are allowed. For example, on a Telnet device, an editable text field is indicated by prompt 515 followed by a highlighted value. A button 530 is indicated by a button name between “<” and “>” characters. A graphical element indicating one choice from a list of predetermined values is indicated by a prompt followed by a highlighted field including the “>” character. In the preferred embodiment, the behavior of the display in response to user actions is provided in the built-in methods defined in the field type beans. Because of the built-in methods, there is no burden on the developer of the application to render instances of the beans on various mobile devices.

The user is free to navigate up and down this page editing the editable fields as desired. When the user is done with editing graphical elements on a page the user selects a graphical element indicating the user's desire to exit the page. In the example, the “submit” button provides that capability. Because the submit button is a button, moving the cursor to the line is not sufficient to exit the page. Rather, the user must also press another key, such as an “enter” key. If the application provides for additional functionality, then the user is presented with a new page of graphical elements with which to interact. In one embodiment, the state machine or client process provides the behavior for the cursor movement keys and changing fields on the same page; the application provides the behavior from when the page is submitted until the next page is rendered.

Interaction with a list of values field element 520 also involves displaying a new page to the user in this example. FIG. 5B is a diagram that illustrates an embodiment of a next page 510 on a display of a mobile device as a result of selecting the list of values field element. In this case, the new page includes a numbered list of values that can be selected as the current value for the LOV graphical element. In some embodiments, this list is an instance of a list bean—one of the nine field type beans. After the user selects one or more of the values on this list, the user selects the select button at the bottom of the page to make the choice effective. If only one value is allowed, as in the illustrated example, then it would be sufficient for the user to press a key when the cursor is located over the desired value. After making this choice, the user is presented with another instance of the previous page but with the chosen value in the list of values field element.

The application developer may allow a user to navigate to multiple pages from the same page. The application developer simply includes references to different pages in several different fields. For example, a page may have three text field objects and have a different page reference in the Next Page Name attribute of each of the three text field objects. Depending upon which text field the user exits, the mobile interactions server invokes the page constructor of a different page as the next page. This replaces links to other pages with field objects and page event handlers on the server. The next page is identified not with a link but with a name of the next page.

Using this method to navigate among the graphical elements of the application, only references to the graphical elements themselves are passed between the mobile applications server 110 and the client. It is not necessary to provide a full URL padded with values for parameters needed by the destination application, as in conventional methods for providing services on request over a network. It is not necessary to revise the WAP standard to allow cookies. It is not even necessary to send the full unique name of the field object or the next page name to the mobile device. All the information needed by the application is kept on the mobile applications server 110 in the state information maintained by the state machine for the session and is referenced by the unique name of the field object. A mapping between the graphical element reference sent to the mobile client and the unique name of the field object is kept at the listener and used to retrieve useful information in the session memory associated with the graphical element. When a user action is detected by the listener with reference to the graphical element, the listener maps it to the unique name of the field object that corresponds to the graphical element and passes this information to a method, such as an event handler. The method obtains any information needed from the session memory using the unique name of the field object.

Navigation from one page to another is also accomplished in some embodiments using special navigation keys and an event handler for the special keys. FIG. 4A illustrates the flow associated with a special key event. Six generic actions are associated with events passed to handlers of an application. The six generic actions are “next field,” “previous field,” “submit page,” “back page,” “forward page,” and “menu page.” The first three have been described as associated with a cursor down, cursor up and enter key with respect to FIG. 2C. The last three actions, “back page,” “forward page,” and “menu page,” are generated in response to a user pressing a special key, such as “ALT” with the cursor up, cursor down, and enter keys, or with keys F1, F2 and F3 on a personal computer keyboard. Steps 421, 422 and 423 correspond to steps 221, 222, 223 in FIG. 2C, respectively, and represent a listener waiting for and detecting a request message indicating a keystroke by the user, generating an event and invoking a state machine event handler. In step 424, the state machine handler determines whether the keystroke described in the event object is associated with a special key. If not, control passes to step 224 in FIG. 2C to determine whether the keystroke is associated with an exit field. Otherwise, control passes to step 430.

In step 430, the state machine invokes a state machine special key handler with the event object, which invokes an application specific special key handler, if one is provided for the page. The state machine special key handler includes methods for retrieving pages from the session object in either direction from the current page or to exit the application and return to the main menu and to return the resulting XML document to the listener. The forward page action reverses the back page action; if the current page is the last instantiated page, then the forward page action has no effect. The application specific special key handler allows the application developer to provide logic for dealing with the special keys before invoking the state machine methods for moving back or forward through the pages stored in the state machine.

This page by page navigation leaves more room in the limited memory of the mobile device to present the user with more options than is often possible using either cookies or URLs with parameter information, as in the conventional approaches.

Event Driven Interface

In the illustrated embodiment, in which interactions with the client are segregated from the data and logic of the application, the application interacts with a state machine of a mobile interactions server. In the illustrated embodiment, the application receives input from the state machine as generic events, rather than device-specific keystroke events. Consequently, the application in this embodiment includes one or more methods called event handling methods, or simply handlers, to respond to the generic events issued by the state machine. The state machine includes handlers for the all the events and determines whether the application has application specific handlers for the event, as described above with respect to FIG. 2C.

A particular handler for a page object observes only particular events for the pages that instantiate it, not other events or events for other pages. Similarly, a particular handler for a field object observes only particular events for the fields that instantiate it, not other events or events for other fields. This technique implements an observer-observable paradigm in which the events are the observables and the object with included handlers are the observers.

The listeners respond to transport layer request messages from the client process. The requests involve specifics of the base station protocols from which the application is being insulated. The application layer events produced by the listeners and the generic events produced by the state machine are designed to continue to insulate the application from the keystroke specifics of interacting with any of a number of the mobile devices. The generic events for which the application developer may include application-specific handlers are:

-   -   field entered     -   field exited     -   page entered     -   page exited     -   special page key pressed     -   application entered, and     -   application exited.

Within each handler for these events, application specific behavior is programmed that depends on one or more of the six generic actions “next field,” “previous field,” “submit page,” “back page,” “forward page,” and “menu page” generated by the mobile interactions server in response to one or more keystrokes by a user of the mobile device.

FIG. 4B is a flow chart for some exception handlers of the mobile interactions server. Exceptions are special events that cause corresponding exception handlers to be invoked. In one embodiment, the mobile interactions server includes built-in exception handlers at least for the exceptions depicted in FIG. 4B.

In step 441 an application specific page event handler is invoked by the corresponding state machine page event handler. The page event is either a page entered event or a page exited event or a special key pressed event. If the event handler does not return control to the invoking method, the event handler throws an exception. Step 442 represents a branch point for the case in which no exception is thrown. If no exception is thrown, control passes back to the invoking method in step 443 to invoke the next handler for the event object.

If the event handler determines that a condition for termination of the application has occurred, the handler throws a “no more pages” exception. Step 444 represents the branch point for the case in which the exception is a “no more pages” exception. In step 445 the exception handler for the “no more pages” exception invokes the state machine exit application method, which determines whether there is an application specific exit application handler in the application's menu item bean. As described above, after the application specific exit application handler is invoked, the state machine regenerates the main menu and presents the main menu to the client process through the presentation manager.

If the event handler determines that a request should be issued to another resource on the network, such as a database server, the handler throws a redirect exception. Such a redirect is expected only from a page entered event handler for a page. The other resource is identified by its URL, complete with any parameters needed to particularize the request. For example, if the other resource is a database server, the URL includes the SQL statement that specifies the database operation desired. The redirect exception includes the URL loaded with input parameters. In step 446 it is determined that the exception is a redirect to a URL and control passes to step 447. In step 447 the redirect exception handler sends a request addressed to the URL, receives an HTML document in response, adds the HTML to the session object in association with the page and invokes a method of the page, such as the page entered handler or the page exited handler, the latter shown in FIG. 4B. The page method invoked produces or modifies field objects on the page based on the HTML document.

Though depicted in FIG. 4B as being thrown by a page event handler, the next three exceptions can be thrown by a field event handler or a menu item event handler as well. If the event handler throws an abort handler exception, as indicated by the branch point in step 450, then control passes to the abort exception handler which performs step 451. In step 451 the exception handler skips any other handlers of the event object. Data is generated that indicates the location of the cursor is in the graphical element corresponding to the field object that is the source of the event object.

If the event handler throws an interrupted handler exception, as indicated by the branch point in step 452, then control passes to the interrupted exception handler which performs step 453. In step 453 the exception handler invokes the other handlers of the event object. Data is generated that indicates the location of the cursor is in the graphical element corresponding to the field object that is the source of the event object.

If the event handler throws a default-only handler exception, as indicated by the branch point in step 454, then control passes to the default-only exception handler which performs step 455. In step 455 the exception handler skips the other handlers of the event object. Data is generated that indicates the location of the cursor is in the graphical element corresponding to the field object that is the source of the event object. The state machine handler for that field object is then invoked, if not already invoked.

The proper application handler is invoked during the corresponding event through the event driven interface. As noted above, an interface specifies the name and type of the parameters of a method and the name and type of the returned value, if any.

Table 10 shows statements used to define the event handlers interface. The event handlers respond to the generic events generated by the mobile interactions server rather than to transport layer events that the listener 152 responds to. In the terminology used in the following tables, the “Listeners” are the application specific event handlers that are invoked by the mobile interactions server when a generic event is generated.

TABLE 10 An event handling method interface statement number JAVA statement defining Event Handler (Listener) Interface 1 public interface MWAListener extends java.util.EventListener { } 2 public interface MWAFieldListener extends MWAListener { 3  void fieldEntered (MWAEvent e) throws AbortHandlerException, 4  InterruptedHandlerException, DefaultOnlyHandlerException; 5  void fieldExited (MWAEvent e) throws AbortHandlerException, 6  InterruptedHandlerException, DefaultOnlyHandlerException; 7 } 8 public interface MWAPageListener extends MWAListener { 9  void pageEntered (MWAEvent e) throws AbortHandlerException, 10  InterruptedHandlerException, DefaultOnlyHandlerException, 11  RedirectHandlerException; 12  void pageExited (MWAEvent e) throws AbortHandlerException, 13  InterruptedHandlerException, DefaultOnlyHandlerException, 14  NoMorePagesHandlerException; 15  void specialKeyPressed (MWAEvent e) throws AbortHandlerException, 16  InterruptedHandlerException, DefaultOnlyHandlerException; 17 } 18 public interface MWAAppListener extends MWAListener { 19  void AppEntered (MWAEvent e) throws AbortHandlerException, 20  InterruptedHandlerException, DefaultOnlyHandlerException; 21  void AppExited (MWAEvent e) throws AbortHandlerException, 22  InterruptedHandlerException, DefaultOnlyHandlerException; 23 }

Line 1 indicates that the mobile interactions server event handler, herein named the “MWAListener” where MWA stands for mobile wireless applications, is an interface that extends the EventListener interface provided by the java utilities package “java.util.”

Lines 2 though 7 further define the interface for the field event handler, herein named “MWAFieldListener for generic field events. These statements indicate that the field event interface extends the mobile interactions server event handler interface by defining two event handling interfaces. In lines 3–4, a fieldEntered handler interface is defined that takes an event object “e” of type “MWAEvent” and may throw any of the three named exceptions. The MWAEvent is defined elsewhere in the JAVA class file where the statements of Table 10 are stored. In lines 5–6 a fieldExited handler interface is defined with similar properties.

Similarly, lines 18 through 23 further define the interface for the application level (menu item) event handler, herein named “MWAAppListener” for two generic events. This interface defines the AppEntered handler interface and an AppExited handler interface defined similarly to the FieldEntered and FieldExited interfaces described above, respectively.

Similarly, lines 8 through 17 further define the interface for the page event handler, herein named “MWAPageListener” for three generic events. This interface defines the PageEntered handler interface and an PageExited handler interface defined similarly to the FieldEntered and FieldExited interfaces described above, respectively. Furthermore, as indicated in line 11, the PageEntered handler may also throw a “RedirectHandlerException” to redirect the mobile interactions server to a network resource with a specified URL, as described above. Also, as indicated in line 14, the PageExited handler may throw a “NoMorePagesHandlerException” to allow the mobile interactions server to invoke the AppExited handler, as described above. In addition, the MWAPageListener interface includes another interface for the specialKeyPressed handler as defined in lines 15–16.

Table 11 shows statements used to implement an event handler interface in one embodiment. In this example, application-specific handlers are implemented only for the generic event for a special key being pressed, used during page navigation, and not for page entered and page exited events of the page interface.

TABLE 11 An example event handling method state- ment number JAVA statement 1 public class NavigHandler implements MWAPageListener{ 2  void pageEntered (MWAEvent e) { } 3  void pageExited (MWAEvent e) { } 4  void specialKeyPressed (MWAEvent e) { 5  MWASession S = e.getSession( ); 6  if (e.getAction( ).equalsIgnoreCase(“MWA_BACK”)) { 7   if (e.getSource( ).equalsIgnoreCase(“PAGE2”) { 8   MWALib.setError( ); 9   } 10   else{ 11   PageBean PP = S.getPreviousPage( ); 12   TextFieldBean TF = S.getField(PP.Name + “.Title”); 13   TF.setPrompt(TF.getPrompt + “ Again”); 14   } 15  } 16  if (e.getAction( ).equalsIgnoreCase(“MWA_FORWARD”)) { 17   MWALib.setError( ); 18  } 19  if (e.getAction( ).equalsIgnoreCase(“MWA_MENU”)) { } 20  } 21 }

The statement in line 1 indicates that the class named “NavigHandler” provides the instructions for the methods that are consistent with the MWAPageListener interface. That is, the methods of NavigHandler have the names, parameter names and types, and return types specified in the MWAPageListener interface listed in Table 10.

Lines 2–3 indicate that two methods do almost nothing. The pageEntered method and the pageExited method simply accept the event object as input and return immediately. This means that all the functionality performed on entering and exiting pages is based on the state machine methods alone. The methods perform no application-specific functions.

The statements on lines 4–20 are the instructions for a specialKeyPressed method. Line 5 indicates the “getsession” method of the event object “e” is invoked to return a session object (type MWASession defined elsewhere in the java code and not shown here) associated with the event object. The developer has chosen to call this session object “S” for purposes of this method. In line 6 the term “MWA_BACK” is compared to the generic action based on the user input that is included in the event object “e.” The comparison method that disregards capitalization called “equalsIgnoreCase” returns a value “true” if the term input as a parameter “MWA_BACK” is the same, ignoring case, as the text string returned from the “getAction” method of the event object “e.” MWA_BACK” is the special action in this embodiment corresponding to the “page back” action described above. If the expression in line 6 is true, then the instruction in lines 7–8 are followed. If not, the instructions on lines 11–13 are followed. In line 7 it is determined whether the source of the event is named “PAGE2”, if so the MWA library routine setError is invoked to throw an exception. The effect of lines 6–9 is to throw an exception to the mobile interactions server if the user tries to press a special key signifying a page back action while the page named “PAGE2” is being displayed. This block prevents a user from navigating to pages visited prior to PAGE2.

The statements in lines 11–13 are followed if the user is paging back from some other page. These instructions add the word “Again” to the title field of the page being revisited in response to the page back action. These instructions illustrate the use of the state information maintained by the state machine in a session object by an application. The statement in line 11 indicates that the previous page is obtained using the “getPreviousPage” method of the session object S, and assigned to a PageBean object named “PP.” This page bean has a name indicated by PP.Name. A field named “Title” on the previous page is referenced in the session object by a unique name in the namespace as described above, by appending the field name to the page name. Thus the expression ‘PP.Name+“.Title”’ indicates the unique name of the field. In line 13 the text field object named Title on the previous page is placed in a text field object called “TF.” The statement on line 13 indicates that the string in the prompt field of the Title text field is set, using the text field bean method “setPrompt,” to the text passed as a parameter. The text passed as a parameter is the text already in that field, obtained using the text field bean method “getPrompt.” with the word “Again” appended.

The statements in lines 16–17 do not allow a user to page forward, even after paging back through an application. The user is forced to submit each page using the normal procedures, not using the special key for paging forward. The statement in line 16 determines whether the action is “MWA_FORWARD.” If so, the statement in line 17 is followed which invokes the setError method to throw an exception.

The statement in line 19 determines whether the action is the “page to menu” action represented by “MWA_MENU” in this embodiment. If so, the method simply returns without doing anything more. Therefore the menu action is handled entirely by the state machine menu special key event handler.

The NavigHandler of Table 11 is used on pages that the developer wants to prevent the user from leaving by paging forward, or prevent the user from leaving by paging back beyond PAGE2. The developer warns the user that a page is reached through a page back action by adding the word “Again” to the title each time. None of the statements in Table 11 require the developer to know any specifics about the mobile device on which the client is operating. Furthermore, the developer is not required to know the details about how the state information employed is stored or retrieved. The state information is readily available for any event handler that employs it.

Table 12 shows statements used to include the event handler defined in Table 11 in a page bean in one embodiment. In this example, a LOCATION page defines two text fields, A and B, for reporting the address, and adds the two text fields to the page. Table 12 also employs event handlers to allow a text field to be affected by user actions in another text field.

TABLE 12 An example page bean using the event handling method of Table 11 statement number JAVA statement 1 public class LOCATION extends PageBean{ 2  LOCATION( ) { 3  this.addListener ( new NavigHandler ( ) ); 4  this.addListener ( new AListener ( ) ); 5  this.addListener ( new BListener ( ) ); 6  TextFieldBean A = new TextFieldBean ( ); 7  A.setName (“AddressA”); 8  A.setValueType (“S”); 9  A.setPrompt (“Street Address”); 10  A.setLength (30); 11  A.addListener ( new Blistener ( ) ); 12  TextFieldBean B = new TextFieldBean ( ); 13  B.setName (“AddressB”); 14  B.setValueType (“S”); 15  B.setPrompt (“City/State/Zip”); 16  B.setLength (30); 17  this.addFieldBean (A); 18  this.addFieldBean (B); 19  } 20 } 21 public class AListener implements MWAPageListener { 22  public void pageEntered (MWAEvent e) { } 23  public void pageExited (MWAEvent e) { } 24  public void specialKeyPressed (MWAEvent e) { } 25 } 26 public class BListener implements MWAFieldListener, MWAPageListener { 27  public void pageEntered (MWAEvent e) { } 28  public void fieldExited (MWAEvent e) { 29  if ( e.getOwner( ).equalsIgnoreCase (“AddressA”) ) { 30   MWASession S = e.getSession( ); 31   TextFieldBean TF1 = S.getField(“LOCATON.AddressA”); 32   TextFieldBean TF2 = S.getField(“LOCATON.AddressB”); 33   B.setPrompt ( TF1.getValue + “ is in which ” + TF2.getPrompt ); 34  } 35  } 36  public void fieldEntered (MWAEvent e) { } 37  public void pageExited (MWAEvent e) { } 38  public void specialKeyPressed (MWAEvent e) { } 39 }

The statement in lines 1–20 define a LOCATION page bean by extending the mobile interactions server page bean. This LOCATION page bean inherits all the attributes and methods of a mobile applications page bean described above; and the LOCATION page bean is instantiated at runtime to generate a LOCATION type page object.

The statement in line 3 indicates the event handling methods of the NavigHandler class, defined in Table 11, are instantiated in this page bean. The addListener method of JAVA beans is employed to instantiate the methods of the NaviHandler. This statement ensures that when a LOCATION page object is entered or exited the NavigHandler method will be invoked.

The statements in lines 4–5 instantiate event handling methods defined by the classes AListener and BListener defined in lines 21–25 and 26–39, respectively. The only event handler with application specific logic in these two classes of methods is a field exited handler defined in the BListener in lines 28–34. These statements are described in greater detail below. Because the AListener does not provide any application specific logic in this embodiment, the same effect would be obtained if the AListener class had not been included.

The statements in lines 6–10 instantiate a text field bean and assign values to the attributes Name, ValueType, Prompt and Length. The statement in line 6 defines the object A of type TextFieldBean to be a new instance of the text field bean. When instantiated in line 6, the object A has the default attributes defined in Table 1 for a text field bean object. For example, the text field is editable (the Editable attribute is “true”). Thus the object A can be used to accept user input text. The bean “set attribute” methods are used to assign values that override the default values in lines 7–10. As a result of these assignments, text field object A on Page LOCATION has a bean name “AddressA” and prompts a user for input with the text string “Street Address.”

The statement in line 11 associates an event handler with events that involve object A. The bean method addListener of the text field bean object A is employed to add an instance of the event handlers of the class BListener to the object A. The effect of adding these event handlers is described below.

The statements in lines 12–16 for text field bean object B correspond to the lines 6–10 for text field bean object A. The only difference is that the bean name of object B is “AddressB” and the prompt is “City/State/Zip.” No event handler is added to the text field bean object B.

The statements in lines 17–18 employ a bean page method named “addFieldBeans” to add field beans to the page when the page is instantiated. The statement in line 17 adds the instance of field A to the LOCATION page when the page is instantiated, at runtime. The statement in line 18 adds the instance of field B to the LOCATION page when the page is instantiated.

Lines 21–39 of Table 12 include statements that define the application specific event handler methods in the classes AListener and BListener. Only the “fieldExited” handler of the BListener, in lines 28–36, includes application specific logic. When a field associated with the BListener is exited in response to a user operating a mobile device, the handler is invoked, and the expression in the statement in line 29 produces a value of “true” if the source, or “owner,” of the event is a field named “AddressA.” The expression uses the event object method “getOwner” and the getOwner method “equalsIgnoreCase” to determine whether the source is a field named “AddressA”. If this expression is not true, then the handler simply returns without doing anything more.

The object A is associated with the BListener by the statement in line 11. Thus, if the user strokes a cursor up or a cursor down or an enter key while the cursor is located on a graphical element associated with object A, then the event handler in lines 28–36 is invoked. In this case, the expression evaluated in line 29 is true, the source of the event is the field object A with name “AddressA.”

The statement in line 30 is then executed to obtain the session object from the event object so that state information can be obtained and used. The statements in line 31 and 32 create local text field bean objects TF1 and TF2 to hold the bean objects returned from the getField method of the session object S. Each of the desired fields is obtained by reference using the unique name generated by appending the field name to the page name “LOCATION.” In line 33 the prompt for the AddressB object is replaced by a string consisting of the Value in the AddressA object at the time the field is exited with the words “is in which” appended and the former value of the prompt, also appended. In this way, the information input into the field object A becomes part of the prompt for field object B.

For example, a user has typed the text “1600 Pennsylvania Ave.” into a graphical element corresponding to field object A, and pressed the enter key. This causes the application-specific event handler “exitField,” of BListener associated with object A to be invoked. The handler retrieves the value of object A using the object session and incorporates that string into the prompt string for field B, which now reads “1600 Pennsylvania Ave. is in which City/State/Zip.”

Using this event driven interface, events are triggered in the application layer, allowing a developer to program applications as a hierarchy of observers each dealing with a manageable number of observables. Application specific event handlers can be included in field objects, page objects and the menu item object of the application hierarchy to provide the desired behavior for the application. There is no restriction on how many handlers an application can define. Built-in state machine event handlers insulate the application handlers from low level user actions such as pointing device manipulation and individual keystrokes. The built-in state machine event handlers also provide automatic navigation from page to page of the application. In addition, the application specific handlers may throw exceptions to invoke built-in exception handlers for obtaining a response from a separate network resource, for exiting an application specific handler abnormally, and for terminating the application.

Multiple-Device Presentation Manager

FIG. 6A is a flowchart that illustrates one embodiment 610 of a method for a device-sensitive presentation manager to prepare page output for a particular mobile device. In the illustrated embodiment shown in FIG. 1D, the presentation manager 140 is a process within the listener 152 b of the mobile interactions server 150 b. In another embodiment, the device-sensitive presentation manager is a process of the mobile interactions server that is separate from the listener.

In step 602, the presentation manager receives an XML document describing a page object or field object for rendering at the client process on the mobile device. For example, a XML document describing a page object is received that is sent with the original menu in step 212 of FIG. 2A. As another example, a page object is received that is sent from an application to the state machine and from the state machine to the presentation manager in steps 248 of FIG. 2C. At this stage, it has not been determined whether the entire page will fit on the display or in the page buffer of the mobile device. The page object represents the device-independent view from the application perspective concerning the amount of information the user of the mobile device should have at one time to effectively navigate through the application.

In step 604, the presentation manager obtains information about the specific mobile device on which the client is executing. This information is obtained from the device profile 145 (FIG. 1D), and is constructed when the session began, as described above in FIG. 2A at step 204. This device-specific information includes a form factor describing the dimensions of the display, capabilities of the display, input buffer size, or other device specific information.

In step 606, the presentation manager builds one or more pages in a common markup language based on the received page object and the display form factor from the device profile. For example, if the page object includes 14 field beans as shown in FIG. 5A, but the particular mobile device to which the page is to be sent is so tiny that it can only display four lines at a time and its page buffer can only hold the text for 128 characters, including non-displayed characters like line end, tab and page end, then the entire page object cannot be sent to the particular mobile device at one time.

An embodiment of step 606 divides the information shown in FIG. 5A, and described in the common markup language, such as XML, among device-specific pages. For example, an embodiment of step 606 generates four device-specific pages, each with one line displaying both the page title and the submit button, while the other three lines on each device-specific page display three of the remaining 12 field beans. Each device-specific page includes a subset of the graphical elements in the page object. Among the graphical elements in the subset is the current graphical element where the cursor is located, also called the graphical element in focus. In one embodiment only the device-specific page for the subset including the graphical element in focus is formed.

In this embodiment, the device-specific pages are expressed in a common markup language. In the preferred embodiment, XML is used as the common markup language. The use of XML is advantageous because, among other reasons, converters already exist that convert XML documents to HTML documents for use by browsers and WML documents for use by WAP devices as well as for HDML, and VoxML.

In step 608, the device-specific XML pages are sent to a converter routine 114 to convert them to a format for the client protocol, such as WML, HDML. VoxML, Telnet and HTML.

When a page object generated by the application has been reformatted into more than one device-specific pages, the user of the mobile device may use the cursor placement keys, such as an up key and a down key, to move off a particular device-specific page. For example, the user of the mobile device hits a down key when the cursor is positioned on the fourth and final line of the device-specific page described above with respect to step 606 of FIG. 6A. According to one embodiment, the device handler of the application does not include logic to handle this circumstance. The application is unaware of the device-specific pages built by the presentation manager. According to this embodiment, the listener still invokes the state machine method for the key pressed and the state machine generates a responsive XML document and the presentation manager re-generates a device-specific page that includes the current field.

FIG. 6B is a flowchart that illustrates the steps performed by one embodiment 640 of the converter routine 114. In step 642 the converter receives the XML document provided by the listener or the device-specific XML document provided by the presentation manager. In step 643 it is determined whether the client process is using a protocol that accepts documents that can be generated with a conventional XML converter 112, such as WML, HDML, VoxML and HTML. If so, control passes to step 646 to send the XML document to the conventional XML converter 112. If not, control passes to step 644 to communicate with the client process in the protocol of the client process (e.g., Telnet) based on the information in the XML document and the information about the mobile device in the device profile database 145.

Application Development Method

FIG. 7 is a flowchart that illustrates one embodiment 710 of a method for an application developer to utilize a mobile interactions server.

In step 702, the developer generates an application made up of one or more pages each comprising one or more fields. In the preferred embodiment, each field is an instance of one of nine field type beans. In this embodiment, each page is an instance of a page bean.

In step 704, the developer generates a page event handler for each event associated with the page. The page event handler includes logic to execute based on a generic event generated by the mobile interactions server in response to a user of the mobile device acting on a graphical element corresponding to a field object on the page. The event includes an indication of a generic action performed by the user, and a reference to session state information. In the preferred embodiment, the page is a page bean object and the event handler is a page bean event handler method, and the fields are field type bean objects. A listener process passes an event object to the event handler method when calling the method, and the event object includes a reference to the field bean in the session object maintained by a state machine. Also the field beans include built-in field even handlers. Then, the application specific logic can be based on any information in the event object or the session object.

In step 706, the developer registers the application with the mobile interactions server. In the preferred embodiment, the developer generates a menu item bean including a method to execute when the application is first called, and a reference to the first page. Then a reference to the menu item bean, such as a URL identifying a file where a menu item bean is stored, is associated with a menu item added to a list of menu items presented to a client by the mobile interactions server as a main menu. In the preferred embodiment, the mobile interactions server provides a registration process. The developer runs the registration process and enters the reference to the menu item bean when prompted by the registration process. The developer also enters a label for the application that is used as the text for the label item on the main menu.

Hardware Overview

FIG. 8 is a block diagram that illustrates a computer system 800 upon which an embodiment of the invention may be implemented. Computer system 800 includes a bus 802 or other communication mechanism for communicating information, and a processor 804 coupled with bus 802 for processing information. Computer system 800 also includes a main memory 806, such as a random access memory (“RAM”) or other dynamic storage device, coupled to bus 802 for storing information and instructions to be executed by processor 804. Main memory 806 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 804. Computer system 800 further includes a read only memory (“ROM”) 808 or other static storage device coupled to bus 802 for storing static information and instructions for processor 804. A storage device 810, such as a magnetic disk or optical disk, is provided and coupled to bus 802 for storing information and instructions.

Computer system 800 may be coupled via bus 802 to a display 812, such as a cathode ray tube (“CRT”), for displaying information to a computer user. An input device 814, including alphanumeric and other keys, is coupled to bus 802 for communicating information and command selections to processor 804. Another type of user input device is cursor control 816, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 804 and for controlling cursor movement on display 812. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.

The invention is related to the use of computer system 800 for providing network applications for wireless mobile devices. According to one embodiment of the invention, a page for display on the mobile device is provided by computer system 800 in response to processor 804 executing one or more sequences of one or more instructions contained in main memory 806. Such instructions may be read into main memory 806 from another computer-readable medium, such as storage device 810. Execution of the sequences of instructions contained in main memory 806 causes processor 804 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software.

The term “computer-readable medium” as used herein refers to any medium that participates in providing instructions to processor 804 for execution. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical or magnetic disks, such as storage device 810. Volatile media includes dynamic memory, such as main memory 806. Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 802. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.

Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.

Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to processor 804 for execution. For example, the instructions may initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to computer system 800 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 802. Bus 802 carries the data to main memory 806, from which processor 804 retrieves and executes the instructions. The instructions received by main memory 806 may optionally be stored on storage device 810 either before or after execution by processor 804.

Computer system 800 also includes a communication interface 818 coupled to bus 802. Communication interface 818 provides a two-way data communication coupling to a network link 820 that is connected to a local network 822. For example, communication interface 818 may be an integrated services digital network (“ISDN”) card or a modem to provide a data communication connection to a corresponding type of telephone line. As another example, communication interface 818 may be a local area network (“LAN”) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface 818 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.

Network link 820 typically provides data communication through one or more networks to other data devices. For example, network link 820 may provide a connection through local network 822 to a host computer 824 or to data equipment operated by an Internet Service Provider (“ISP”) 826. ISP 826 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 828. Local network 822 and Internet 828 both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals on network link 820 and through communication interface 818, which carry the digital data to and from computer system 800, are exemplary forms of carrier waves transporting the information.

Computer system 800 can send messages and receive data, including program code, through the network(s), network link 820 and communication interface 818. In the Internet example, a server 830 might transmit a requested code for an application program through Internet 828, ISP 826, local network 822 and communication interface 818. In accordance with the invention, one such downloaded application provides for a user interface as described herein.

The received code may be executed by processor 804 as it is received, and/or stored in storage device 810, or other non-volatile storage for later execution. In this manner, computer system 800 may obtain application code in the form of a carrier wave.

Scope

In the foregoing specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. In particular the order of some steps in the flow charts can be changed without affecting adversely the practice of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. 

1. A method of interacting with a client process on a mobile device connected to a network over a wireless link, the method comprising the steps of: receiving at a mobile interactions server a first message from the client process indicating a first action by a user of the mobile device, the first action related to a first graphical element displayed on the device for requesting a service form an application; based on the first message, determining whether the action is associated with an event type of a plurality of predetermined event types; wherein each of the predetermined event types corresponds to one or more application-specific event objects used for invoking a specific method of the application; if it is determined the action is not associated with the event type, then, without invoking any method of the application, generating first data describing any change in the first graphical element; and sending the first data to the client process for changing the display of the first graphical element.
 2. The method of claim 1, further comprising, if it is determined the action is associated with the event type, then performing the steps of: generating second data describing a particular event of the event type; invoking a particular event handling method of the application to provide the service, the particular event handling method associated with the event type; and passing the second data to the event handling method.
 3. The method of claim 1, further comprising, before said step of receiving the first message, the steps of: receiving second data from the application describing the first graphical element and indicating one or more event handling methods associated with the first graphical element; and passing the second data to the client process for displaying the first graphical element.
 4. The method of claim 3, wherein each of the one or more event handling methods is associated with one event type of the plurality of predetermined event types.
 5. The method of claim 2, wherein the particular event handling method is associated with one event type of the plurality of predetermined event types.
 6. The method of claim 5, wherein a name of the particular event handling method indicates the one event type with which it is associated.
 7. The method of claim 2, wherein the particular event handling method is associated with the first graphical element.
 8. The method of claim 1, wherein the plurality of predetermined events types does not include an event type associated with the user of the mobile device pressing a character key.
 9. The method of claim 1, wherein the plurality of predetermined event types includes an exit-graphical-element event type and an enter-graphical-element event type.
 10. The method of claim 9, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to one of moving a cursor from the first graphical element and pressing an enter key; and if the first action does correspond to one of moving the cursor from the first graphical element and pressing the enter key, then the first action is associated with the exit-graphical-element event type.
 11. The method of claim 9, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to moving a cursor onto the first graphical element; and if the first action does correspond to moving the cursor onto the first graphical element, then the first action is associated with the enter-graphical-element event type.
 12. The method of claim 1, wherein the first graphical element is included in a page of one or more graphical elements associated with requesting the service from the application; and the plurality of predetermined event types includes an exit-page event type and an enter-page event type.
 13. The method of claim 12, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to pressing an enter key on a graphical element associated with a reference to a different page; and if the first action does correspond to pressing the enter key on the graphical element associated with the reference to the different page, then the first action is associated with the exit-page event type and the enter-page event type.
 14. The method of claim 12, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to pressing an enter key on a last graphical element on the page; and if the first action does correspond to pressing the enter key on the last graphical element on the page, then the first action is associated with the exit-page event type.
 15. The method of claim 1, wherein the first graphical element is included in a page of one or more graphical elements associated with requesting the service from the application; and the plurality of predetermined event types includes an special-key-pressed event type.
 16. The method of claim 15, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to one of pressing a page-back key, pressing a page-forward key and pressing a menu key; and if the first action does correspond to one of pressing a page-back key, pressing a page-forward key and pressing a menu key, then the first action is associated with the special-key-pressed event type.
 17. The method of claim 1, wherein the plurality of predetermined event types includes an exit-application event type and an enter-application event type.
 18. The method of claim 17, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to pressing an enter key on a graphical element associated with a main menu item; and if the first action does correspond to pressing the enter key on the graphical element associated with the main menu item, then the first action is associated with the enter-application event type.
 19. The method of claim 17, wherein: the first graphical element is included in a page of one or more graphical elements associated with requesting the service from the application; the application includes one or more pages; and said step of determining whether the action is associated with an event type further comprising determining whether the first message indicates the first action corresponds to pressing an enter key on a last graphical element on a page without a reference to a different page; and if the first action does correspond to pressing the enter key on the last graphical element on the page without the reference to the different page, then the first action is associated with the exit-application event type.
 20. The method of claim 2, further comprising, if the particular event handling method determines no more pages of one or more graphical elements are to be provided by the application, then receiving third data indicating a particular exception in a particular event exception handling method of the mobile interactions server for exiting the application.
 21. The method of claim 2, further comprising, if the particular event handling method determines a request is to be made to a network resource having a particular URL address, then receiving third data indicating a particular exception and the URL address in a particular event exception handling method of the mobile interactions server for sending the request to the network resource.
 22. The method of claim 2, further comprising, if the particular event handling method determines not to complete processing of the particular event, then receiving third data indicating a particular exception in a particular event exception handling method of the mobile interactions server for skipping all remaining event handling methods for the particular event.
 23. The method of claim 2, further comprising, if the particular event handling method determines not to complete processing of the particular event, then receiving third data indicating a particular exception in a particular event exception handling method of the mobile interactions server for invoking all remaining event handling methods of the application for the particular event.
 24. The method of claim 2, further comprising, if the particular event handling method determines not to complete processing of the particular event, then receiving third data indicating a particular exception in a particular event exception handling method of the mobile interactions server for invoking only the event handling methods of the mobile interactions server for the particular event.
 25. The method of claim 2, wherein the particular event handling method inherits from a first event handling interface provided by the mobile interactions server, the first event handling interface defining the plurality of event types.
 26. The method of claim 25, wherein the first event handling interface inherits from a JAVA event handling interface.
 27. A method of interacting with a client process on a mobile device connected to a network over a wireless link, the method comprising the steps of: sending from an application to a mobile interactions server first data describing a first graphical element for displaying on the mobile device and one or more event handling methods of the application associated with the first graphical element; receiving at a particular event handling method of the plurality of event handling methods second data describing an event having a particular event type of a plurality of predetermined event types in response to an action by a user of the mobile device; wherein each of the predetermined event types corresponds to one or more application-specific event objects used for invoking a specific method of the application; and providing a service for the client process in response to receiving the second data, wherein the particular event handling method is associated with the particular event type, and the action is determined by the mobile interactions server to be associated with the particular event type.
 28. The method of claim 27, the method further comprising the steps of: determining whether to invoke an exception handling method of the mobile interactions server; and if it is determined to invoke the exception handling method, then sending third data describing a particular exception to the exception handling method.
 29. The method of claim 28, wherein the particular exception is associated with no more pages of one or more graphical elements for the client process.
 30. The method of claim 28, wherein the particular exception is associated with redirecting the mobile interactions server to a network resource having a particular URL address.
 31. The method of claim 28, wherein the particular exception is associated with aborting all event handlers for the event.
 32. The method of claim 28, wherein the particular exception is associated with interrupting the particular event handler for the event.
 33. The method of claim 28, wherein the particular exception is associated with invoking only an event handler of the mobile interactions server for the event.
 34. A computer-readable storage medium carrying instructions for interacting with a client process on a mobile device connected to a network over a wireless link, the computer readable medium comprising instructions for causing one or more processors to perform the steps of: receiving over the network a first message from the client process indicating a first action by a user of the mobile device, the first action related to a first graphical element displayed on the device for requesting a service form an application; based on the first message, determining whether the action is associated with an event type of a plurality of predetermined event type; wherein each of the predetermined event types corresponds to one or more application-specific event objects used for invoking a specific method of the application; if it is determined the action is not associated with the event type, then, without invoking any method of the application, generating first data describing any change in the first graphical element; and passing the first data to the client process for changing the display of the first graphical element.
 35. The computer-readable medium of claim 34, the instructions further causing the one or more processors to perform the step of, if it is determined the action is associated with the event type, then: generating second data describing a particular event of the event type; invoking a particular event handling method of the application to provide the service, the particular event handling method defined for the event type; and passing the second data to the event handling method.
 36. The computer-readable medium of claim 34, the instructions further causing the one or more processors to perform the step of, before said step of receiving the first message: receiving second data from the application describing the first graphical element and indicating one or more event handling methods associated with the first graphical element; and passing the second data to the client process for displaying the first graphical element.
 37. The computer-readable medium of claim 36, wherein each of the one or more event handling methods is associated with one event type of the plurality of predetermined event types.
 38. The computer-readable medium of claim 35, wherein the particular event handling method is associated with one event type of the plurality of predetermined event types.
 39. The computer-readable medium of claim 38, wherein a name of the particular event handling method indicates the one event type with which it is associated.
 40. The computer-readable medium of claim 35, wherein the particular event handling method is associated with the first graphical element.
 41. The computer-readable medium of claim 34, wherein the plurality of predetermined events types does not include an event type associated with the user of the mobile device pressing a character key.
 42. The computer-readable medium of claim 34, wherein the plurality of predetermined event types includes an exit-graphical-element event type and an enter-graphical-element event type.
 43. The computer-readable medium of claim 42, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to one of moving a cursor from the first graphical element and pressing an enter key; and if the first action does correspond to one of moving the cursor from the first graphical element and pressing the enter key, then the first action is associated with the exit-graphical-element event type.
 44. The computer-readable medium of claim 42, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to moving a cursor onto the first graphical element; and if the first action does correspond to moving the cursor onto the first graphical element, then the first action is associated with the enter-graphical-element event type.
 45. The computer-readable medium of claim 34, wherein the first graphical element is included in a page of one or more graphical elements associated with requesting the service from the application; and the plurality of predetermined event types includes an exit-page event type and an enter-page event type.
 46. The computer-readable medium of claim 45, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to pressing an enter key on a graphical element associated with a reference to a different page; and if the first action does correspond to pressing the enter key on the graphical element associated with the reference to the different page, then the first action is associated with the exit-page event type and the enter-page event type.
 47. The computer-readable medium of claim 45, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to pressing an enter key on a last graphical element on the page; and if the first action does correspond to pressing the enter key on the last graphical element on the page, then the first action is associated with the exit-page event type.
 48. The computer-readable medium of claim 34, wherein the first graphical element is included in a page of one or more graphical elements associated with requesting the service from the application; and the plurality of predetermined event types includes an special-key-pressed event type.
 49. The computer-readable medium of claim 48, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to one of pressing a page-back key, pressing a page-forward key and pressing a menu key; and if the first action does correspond to one of pressing a page-back key, pressing a page- forward key and pressing a menu key, then the first action is associated with the special-key-pressed event type.
 50. The computer-readable medium of claim 34, wherein the plurality of predetermined event types includes an exit-application event type and an enter-application event type.
 51. The computer-readable medium of claim 50, said step of determining whether the action is associated with an event type further comprising: determining whether the first message indicates the first action corresponds to pressing an enter key on a graphical element associated with a main menu item; and if the first action does correspond to pressing the enter key on the graphical element associated with the main menu item, then the first action is associated with the enter-application event type.
 52. The computer-readable medium of claim 50, wherein: the first graphical element is included in a page of one or more graphical elements associated with requesting the service from the application; the application includes one or more pages; and said step of determining whether the action is associated with an event type further comprises determining whether the first message indicates the first action corresponds to pressing an enter key on a last graphical element on a page without a reference to a different page; and if the first action does correspond to pressing the enter key on the last graphical element on the page without the reference to the different page, then the first action is associated with the exit-application event type.
 53. The computer-readable medium of claim 35, the instructions further causing the one or more processors to perform the step of, if the particular event handling method determines no more pages of one or more graphical elements are to be provided by the application, then receiving third data indicating a particular exception in a particular event exception handling method of the mobile interactions server for exiting the application.
 54. The computer-readable medium of claim 35, the instructions further causing the one or more processors to perform the step of, if the particular event handling method determines a request is to be made to a network resource having a particular URL address, then receiving third data indicating a particular exception and the URL address in a particular event exception handling method of the mobile interactions server for sending the request to the network resource.
 55. The computer-readable medium of claim 35, the instructions further causing the one or more processors to perform the step of, if the particular event handling method determines not to complete processing of the particular event, then receiving third data indicating a particular exception in a particular event exception handling method of the mobile interactions server for skipping all remaining event handling methods for the particular event.
 56. The computer-readable medium of claim 35, the instructions further causing the one or more processors to perform the step of, if the particular event handling method determines not to complete processing of the particular event, then receiving third data indicating a particular exception in a particular event exception handling method of the mobile interactions server for invoking all remaining event handling methods of the application for the particular event.
 57. The computer-readable medium of claim 35, the instructions further causing the one or more processors to perform the step of, if the particular event handling method determines not to complete processing of the particular event, then receiving third data indicating a particular exception in a particular event exception handling method of the mobile interactions server for invoking only the event handling methods of the mobile interactions server for the particular event.
 58. The computer-readable medium of claim 35, wherein the particular event handling method inherits from a first event handling interface provided by the mobile interactions server, the first event handling interface defining the plurality of event types.
 59. The computer-readable medium of claim 58, wherein the first event handling interface inherits from a JAVA event handling interface.
 60. A computer-readable storage medium carrying instructions for interacting with a client process on a mobile device connected to a network over a wireless link, the computer-readable medium comprising instructions for causing one or more processors to perform the steps of: sending to a mobile interactions server first data describing a first graphical element for display on the mobile device an one or more event handling methods of the application associated with the first graphical element; receiving at a particular event handling method of the plurality of event handling methods second data describing an event having a particular event type of a plurality of predetermined event types in response to an action by a user of the mobile device; wherein each of the predetermined event types corresponds to one or more application-specific event objects used for invoking a specific method of the application; and providing a service for the client process in response to receiving the second data, wherein the particular event handling method is associated with the particular event type, and the action is determined by the mobile interactions server to be associated with the particular event type.
 61. The computer-readable medium of claim 60, the instructions further causing the one or more processors to perform the steps of: determining whether to invoke an exception handling method of the mobile interactions server; and if it is determined to invoke the exception handling method, then sending third data describing a particular exception to the exception handling method.
 62. The computer-readable medium of claim 61, wherein the particular exception is associated with no more pages of one or more graphical elements for the client process.
 63. The computer-readable medium of claim 61, wherein the particular exception is associated with redirecting the mobile interactions server to a network resource having a particular URL address.
 64. The computer-readable medium of claim 61, wherein the particular exception is associated with aborting all event handlers for the event.
 65. The computer-readable medium of claim 61, wherein the particular exception is associated with interrupting the particular event handler for the event.
 66. The computer-readable medium of claim 61, wherein the particular exception is associated with invoking only an event handler of the mobile interactions server for the event. 